2024-09-16T11:04:57.586 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T11:04:57.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T11:04:57.690 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165 branch: wip-bharath9-testing-2024-09-13-1444-quincy description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} email: sangadi@redhat.com first_in_suite: false job_id: '7907165' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-bharath9-testing-2024-09-13-1444-quincy ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: d75f23820806da622f561ee5ee7551015285993f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d75f23820806da622f561ee5ee7551015285993f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath9-testing-2024-09-13-1444-quincy sha1: d75f23820806da622f561ee5ee7551015285993f owner: scheduled_sangadi@teuthology priority: 130 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9764 sha1: d75f23820806da622f561ee5ee7551015285993f sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-bharath9-testing-2024-09-13-1444-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d75f23820806da622f561ee5ee7551015285993f targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_10:44:09 tube: smithi user: sangadi verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T11:04:57.691 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa; will attempt to use it 2024-09-16T11:04:57.691 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks 2024-09-16T11:04:57.691 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T11:04:57.693 INFO:teuthology.task.internal:Checking packages... 2024-09-16T11:04:57.713 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd75f23820806da622f561ee5ee7551015285993f' 2024-09-16T11:04:57.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T11:04:57.714 INFO:teuthology.packaging:ref: None 2024-09-16T11:04:57.714 INFO:teuthology.packaging:tag: None 2024-09-16T11:04:57.714 INFO:teuthology.packaging:branch: wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-16T11:04:57.714 INFO:teuthology.packaging:sha1: d75f23820806da622f561ee5ee7551015285993f 2024-09-16T11:04:57.714 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-16T11:04:57.860 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1643-gd75f2382-1focal 2024-09-16T11:04:57.862 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T11:04:57.868 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T11:04:57.868 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T11:04:57.883 INFO:teuthology.task.internal:Saving configuration 2024-09-16T11:04:57.895 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T11:04:57.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T11:04:57.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 10:59:12.073663', 'locked_by': 'scheduled_sangadi@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-16T11:04:57.927 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T11:04:57.932 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T11:04:57.932 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T11:04:57.973 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b1f0afbe0>, signals=[15]) 2024-09-16T11:04:57.973 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T11:04:57.978 INFO:teuthology.task.internal:Opening connections... 2024-09-16T11:04:57.978 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:04:57.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T11:04:58.077 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T11:04:58.083 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-16T11:04:58.203 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-16T11:04:58.203 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-16T11:04:58.209 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2024-09-16T11:04:58.210 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2024-09-16T11:04:58.211 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-16T11:04:58.243 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T11:04:58.251 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T11:04:58.269 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T11:04:58.269 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-16T11:04:58.275 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T11:04:58.306 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T11:04:58.306 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-16T11:04:58.323 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T11:04:58.379 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T11:04:58.393 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T11:04:58.394 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T11:04:58.394 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T11:04:58.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T11:04:58.400 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-16T11:04:58.406 INFO:teuthology.orchestra.run.smithi137.stdout:5.4.0-124-generic 2024-09-16T11:04:58.406 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.4.0-124-generic 2024-09-16T11:04:58.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-16T11:04:58.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-16T11:04:58.739 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T11:04:58.749 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-16T11:04:58.812 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-16T11:04:58.849 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-16T11:04:59.126 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-16T11:04:59.276 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-16T11:04:59.289 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-16T11:04:59.293 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-16T11:04:59.293 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-16T11:04:59.294 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-16T11:04:59.317 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-16T11:04:59.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T11:04:59.320 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-16T11:04:59.326 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-16T11:04:59.334 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-16T11:04:59.336 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-16T11:04:59.336 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-16T11:04:59.337 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-16T11:04:59.363 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-16T11:04:59.363 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-16T11:04:59.364 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-16T11:04:59.364 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-16T11:04:59.365 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-16T11:04:59.365 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-16T11:04:59.365 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-16T11:04:59.366 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-16T11:04:59.455 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-16T11:04:59.791 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-16T11:04:59.983 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-16T11:04:59.997 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-16T11:04:59.998 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-16T11:04:59.999 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-16T11:05:00.089 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-16T11:05:00.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T11:05:00.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-16T11:05:00.122 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-16T11:05:00.148 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-16T11:05:00.155 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-16T11:05:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-16T11:05:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-16T11:05:00.156 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-16T11:05:00.229 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-16T11:05:03.603 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 21.8 MB in 3s (7,028 kB/s) 2024-09-16T11:05:05.160 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:05:05.189 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T11:05:05.259 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:05:05.479 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-16T11:05:05.480 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-16T11:05:05.681 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-16T11:05:05.681 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T11:05:05.681 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-16T11:05:05.681 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-16T11:05:05.682 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-16T11:05:05.682 INFO:teuthology.orchestra.run.smithi137.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-16T11:05:05.682 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-16T11:05:05.683 INFO:teuthology.orchestra.run.smithi137.stdout: thermald 2024-09-16T11:05:05.741 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-16T11:05:05.742 INFO:teuthology.orchestra.run.smithi137.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T11:05:05.742 INFO:teuthology.orchestra.run.smithi137.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-16T11:05:05.742 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-16T11:05:05.743 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-09-16T11:05:05.744 INFO:teuthology.orchestra.run.smithi137.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T11:05:05.926 INFO:teuthology.orchestra.run.smithi137.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T11:05:05.926 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 77.2 MB of archives. 2024-09-16T11:05:05.927 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-16T11:05:05.927 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-16T11:05:07.193 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-16T11:05:07.465 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-16T11:05:08.816 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-16T11:05:08.816 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-16T11:05:08.816 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-16T11:05:09.097 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-16T11:05:09.110 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-16T11:05:09.786 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 77.2 MB in 3s (23.0 MB/s) 2024-09-16T11:05:10.084 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-16T11:05:11.851 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-16T11:05:11.856 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T11:05:11.952 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:13.868 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-16T11:05:13.885 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T11:05:13.981 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:15.088 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-16T11:05:15.101 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T11:05:15.138 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:19.783 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T11:05:19.909 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T11:05:20.228 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T11:05:20.354 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T11:05:20.682 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-16T11:05:20.697 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-16T11:05:20.740 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T11:05:26.793 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-16T11:05:26.815 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T11:05:26.867 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:29.520 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T11:05:29.647 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T11:05:29.974 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:31.987 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:33.423 INFO:teuthology.orchestra.run.smithi137.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-16T11:05:33.423 INFO:teuthology.orchestra.run.smithi137.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-16T11:05:33.539 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:34.698 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T11:05:34.824 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-16T11:05:34.959 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:35.085 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-16T11:05:35.211 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-16T11:05:35.337 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T11:05:35.409 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T11:05:35.409 INFO:teuthology.orchestra.run.smithi137.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-16T11:05:57.410 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T11:05:57.410 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub' 2024-09-16T11:05:57.419 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T11:05:57.435 INFO:teuthology.orchestra.run.smithi137.stdout:Generating grub configuration file ... 2024-09-16T11:05:57.837 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T11:05:57.871 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T11:05:58.298 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T11:05:58.310 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T11:06:00.425 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-09-16T11:06:00.811 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.4.0.195.193 2024-09-16T11:06:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T11:06:00.872 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T11:06:00.872 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-16T11:06:00.872 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-16T11:06:00.872 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-16T11:06:00.872 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-16T11:06:00.872 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-16T11:06:00.872 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T11:06:00.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T11:06:00.873 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T11:06:00.873 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T11:06:00.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2024-09-16T11:06:00.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-16T11:06:01.092 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T11:06:01.092 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T11:06:01.098 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T11:06:01.116 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T11:06:02.955 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:06:02.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T11:06:03.052 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:06:03.271 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-16T11:06:03.272 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-16T11:06:03.510 INFO:teuthology.orchestra.run.smithi137.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-16T11:06:03.510 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T11:06:03.512 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic 2024-09-16T11:06:03.531 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.4.0.195.193 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2024-09-16T11:06:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2024-09-16T11:06:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2024-09-16T11:06:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2024-09-16T11:06:03.533 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-16T11:06:03.581 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.UOpJMA6mEa 2024-09-16T11:06:03.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UOpJMA6mEa 2024-09-16T11:06:03.597 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.UOpJMA6mEa 2024-09-16T11:06:03.645 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.UOpJMA6mEa is 9KB 2024-09-16T11:06:03.659 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.UOpJMA6mEa 2024-09-16T11:06:03.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T11:06:03.723 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:06:03.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T11:06:03.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T11:06:03.761 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-16T11:06:03.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-grub 2024-09-16T11:06:05.015 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2024-09-16T11:06:05.022 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T11:06:05.038 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-09-16T11:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T11:06:05.380 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T11:06:05.791 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T11:06:05.803 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T11:06:06.872 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-09-16T11:06:06.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-09-16T11:06:36.905 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T11:06:36.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:06:36.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T11:06:55.425 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-16T11:07:04.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:07:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T11:07:07.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-16T11:07:19.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:07:19.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T11:07:51.231 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-16T11:07:51.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:07:51.788 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-16T11:07:51.788 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-16T11:07:51.795 INFO:teuthology.orchestra.run.smithi137.stdout:5.4.0-195-generic 2024-09-16T11:07:51.796 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-16T11:07:51.796 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T11:07:51.796 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T11:07:52.797 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T11:07:52.797 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T11:07:52.876 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-09-16T11:07:52.907 DEBUG:teuthology.parallel:result is None 2024-09-16T11:07:52.907 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T11:07:52.914 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T11:07:52.915 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T11:07:52.921 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T11:07:52.929 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T11:07:52.942 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T11:07:52.942 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T11:07:52.970 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T11:07:52.978 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T11:07:52.979 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T11:07:53.026 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T11:07:53.032 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T11:07:53.034 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T11:07:53.041 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T11:07:53.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T11:07:53.057 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T11:07:53.066 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T11:07:53.066 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T11:07:53.073 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T11:07:53.127 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T11:07:53.134 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:07:53.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T11:07:53.168 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-16T11:07:53.217 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T11:07:53.224 INFO:teuthology.task.internal:Starting timer... 2024-09-16T11:07:53.224 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T11:07:53.238 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T11:07:53.252 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2024-09-16T11:07:53.253 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T11:07:53.253 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T11:07:53.253 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T11:07:53.253 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T11:07:53.269 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T11:07:53.280 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T11:07:53.281 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T11:13:22.510 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-09-16T11:13:22.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:13:22.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T11:13:22.608 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-16T11:13:22.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T11:13:22.735 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T11:13:22.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T11:13:22.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T11:13:22.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T11:13:22.812 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-16T11:13:22.812 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Command line: ntpd -gq 2024-09-16T11:13:22.813 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: proto: precision = 0.087 usec (-23) 2024-09-16T11:13:22.813 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T11:13:22.813 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T11:13:22.813 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T11:13:22.814 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen normally on 4 lo [::1]:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2024-09-16T11:13:22.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:22 ntpd[13696]: Listening on routing socket on fd #22 for interface updates 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:23.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:23 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:25 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:26.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:26 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:27.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:27.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:27.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:27.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:27 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:28.813 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:28 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T11:13:29.814 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stdout:16 Sep 11:13:29 ntpd[13696]: ntpd: time slew -0.001283 s 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew -0.001283s 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T11:13:29.815 INFO:teuthology.orchestra.run.smithi137.stderr:16 Sep 11:13:29 ntpd[13696]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T11:13:29.875 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T11:13:29.876 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-16T11:13:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T11:13:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T11:13:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T11:13:29.876 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T11:13:29.876 INFO:teuthology.run_tasks:Running task install... 2024-09-16T11:13:29.884 DEBUG:teuthology.task.install:project ceph 2024-09-16T11:13:29.884 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}} 2024-09-16T11:13:29.884 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'} 2024-09-16T11:13:29.884 INFO:teuthology.task.install:Using flavor: default 2024-09-16T11:13:29.889 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T11:13:29.890 INFO:teuthology.task.install:extra packages: [] 2024-09-16T11:13:29.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2024-09-16T11:13:29.994 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-16T11:13:30.058 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T11:13:30.058 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T11:13:30.059 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T11:13:30.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d75f23820806da622f561ee5ee7551015285993f 2024-09-16T11:13:30.203 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default/ 2024-09-16T11:13:30.204 INFO:teuthology.task.install.deb:Package version is 17.2.7-1643-gd75f2382-1focal 2024-09-16T11:13:30.319 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:13:30.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T11:13:30.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2024-09-16T11:13:30.519 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T11:13:30.576 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal InRelease 2024-09-16T11:13:30.598 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-16T11:13:30.621 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal Release.gpg 2024-09-16T11:13:30.638 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T11:13:30.644 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main i386 Packages [3,392 B] 2024-09-16T11:13:30.675 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2024-09-16T11:13:30.720 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T11:13:30.807 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T11:13:31.181 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 28.5 kB in 1s (44.9 kB/s) 2024-09-16T11:13:32.342 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:13:32.369 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.7-1643-gd75f2382-1focal cephadm=17.2.7-1643-gd75f2382-1focal ceph-mds=17.2.7-1643-gd75f2382-1focal ceph-mgr=17.2.7-1643-gd75f2382-1focal ceph-common=17.2.7-1643-gd75f2382-1focal ceph-fuse=17.2.7-1643-gd75f2382-1focal ceph-test=17.2.7-1643-gd75f2382-1focal ceph-volume=17.2.7-1643-gd75f2382-1focal radosgw=17.2.7-1643-gd75f2382-1focal python3-rados=17.2.7-1643-gd75f2382-1focal python3-rgw=17.2.7-1643-gd75f2382-1focal python3-cephfs=17.2.7-1643-gd75f2382-1focal python3-rbd=17.2.7-1643-gd75f2382-1focal libcephfs2=17.2.7-1643-gd75f2382-1focal libcephfs-dev=17.2.7-1643-gd75f2382-1focal librados2=17.2.7-1643-gd75f2382-1focal librbd1=17.2.7-1643-gd75f2382-1focal rbd-fuse=17.2.7-1643-gd75f2382-1focal 2024-09-16T11:13:32.437 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2024-09-16T11:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2024-09-16T11:13:32.632 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2024-09-16T11:13:32.822 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-16T11:13:32.823 INFO:teuthology.orchestra.run.smithi137.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-16T11:13:32.824 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-16T11:13:32.824 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-16T11:13:32.824 INFO:teuthology.orchestra.run.smithi137.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2024-09-16T11:13:32.824 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2024-09-16T11:13:32.824 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2024-09-16T11:13:32.825 INFO:teuthology.orchestra.run.smithi137.stdout: socat xmlstarlet 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T11:13:32.826 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-16T11:13:32.827 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2024-09-16T11:13:32.827 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T11:13:32.947 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2024-09-16T11:13:32.948 INFO:teuthology.orchestra.run.smithi137.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-16T11:13:32.949 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-16T11:13:32.950 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2024-09-16T11:13:32.950 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 librbd1 2024-09-16T11:13:33.100 INFO:teuthology.orchestra.run.smithi137.stdout:2 upgraded, 108 newly installed, 0 to remove and 295 not upgraded. 2024-09-16T11:13:33.100 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 201 MB of archives. 2024-09-16T11:13:33.100 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 938 MB of additional disk space will be used. 2024-09-16T11:13:33.100 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.7-1643-gd75f2382-1focal [3,508 kB] 2024-09-16T11:13:33.143 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-16T11:13:33.545 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-16T11:13:33.552 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-16T11:13:33.595 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-16T11:13:33.609 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-16T11:13:33.734 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-16T11:13:33.740 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-16T11:13:33.769 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-16T11:13:33.810 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.7-1643-gd75f2382-1focal [3,564 kB] 2024-09-16T11:13:33.910 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-16T11:13:33.918 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-16T11:13:33.941 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-16T11:13:33.948 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-16T11:13:33.949 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-16T11:13:33.956 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-16T11:13:33.957 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-16T11:13:33.958 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-16T11:13:33.958 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-16T11:13:33.992 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-16T11:13:34.044 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-16T11:13:34.045 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-16T11:13:34.046 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-16T11:13:34.046 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-16T11:13:34.048 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T11:13:34.049 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-16T11:13:34.049 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-16T11:13:34.051 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-16T11:13:34.074 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-16T11:13:34.106 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.7-1643-gd75f2382-1focal [761 kB] 2024-09-16T11:13:34.134 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-16T11:13:34.137 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-16T11:13:34.138 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-16T11:13:34.147 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-16T11:13:34.147 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-16T11:13:34.148 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-16T11:13:34.148 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-16T11:13:34.156 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-16T11:13:34.161 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.7-1643-gd75f2382-1focal [414 kB] 2024-09-16T11:13:34.161 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-16T11:13:34.172 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.7-1643-gd75f2382-1focal [22.6 kB] 2024-09-16T11:13:34.173 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.7-1643-gd75f2382-1focal [200 kB] 2024-09-16T11:13:34.196 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.7-1643-gd75f2382-1focal [49.1 kB] 2024-09-16T11:13:34.197 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.7-1643-gd75f2382-1focal [389 kB] 2024-09-16T11:13:34.226 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.7-1643-gd75f2382-1focal [5,637 kB] 2024-09-16T11:13:34.236 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T11:13:34.237 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-16T11:13:34.240 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-16T11:13:34.243 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-16T11:13:34.245 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-16T11:13:34.246 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-16T11:13:34.247 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-16T11:13:34.569 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-16T11:13:34.689 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.7-1643-gd75f2382-1focal [116 kB] 2024-09-16T11:13:34.689 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-16T11:13:34.692 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.7-1643-gd75f2382-1focal [479 kB] 2024-09-16T11:13:34.693 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-16T11:13:34.700 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.7-1643-gd75f2382-1focal [27.0 MB] 2024-09-16T11:13:34.711 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-16T11:13:34.711 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-16T11:13:34.712 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-16T11:13:34.713 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-16T11:13:34.713 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-16T11:13:34.714 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-16T11:13:34.714 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-16T11:13:34.772 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-16T11:13:34.796 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-16T11:13:34.797 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-16T11:13:34.803 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-16T11:13:34.805 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-16T11:13:34.808 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-16T11:13:34.809 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-16T11:13:34.859 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-16T11:13:34.863 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-16T11:13:34.885 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-16T11:13:34.941 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-16T11:13:35.103 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-16T11:13:35.105 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-16T11:13:35.105 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-16T11:13:35.106 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-16T11:13:35.107 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-16T11:13:35.108 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-16T11:13:35.124 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T11:13:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-16T11:13:35.125 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-16T11:13:35.186 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-16T11:13:35.267 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-16T11:13:35.268 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-16T11:13:35.268 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-16T11:13:35.271 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-16T11:13:35.272 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-16T11:13:35.600 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.7-1643-gd75f2382-1focal [5,178 kB] 2024-09-16T11:13:35.828 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.7-1643-gd75f2382-1focal [223 kB] 2024-09-16T11:13:35.830 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.7-1643-gd75f2382-1focal [157 kB] 2024-09-16T11:13:35.831 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.7-1643-gd75f2382-1focal [1,594 kB] 2024-09-16T11:13:35.867 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.7-1643-gd75f2382-1focal [4,684 kB] 2024-09-16T11:13:36.086 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.7-1643-gd75f2382-1focal [23.1 MB] 2024-09-16T11:13:36.845 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.7-1643-gd75f2382-1focal [3,940 B] 2024-09-16T11:13:36.845 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.7-1643-gd75f2382-1focal [871 kB] 2024-09-16T11:13:36.860 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.7-1643-gd75f2382-1focal [2,418 kB] 2024-09-16T11:13:36.877 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.7-1643-gd75f2382-1focal [81.4 kB] 2024-09-16T11:13:36.878 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.7-1643-gd75f2382-1focal [120 kB] 2024-09-16T11:13:36.906 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.7-1643-gd75f2382-1focal [6,653 kB] 2024-09-16T11:13:37.210 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.7-1643-gd75f2382-1focal [7,885 kB] 2024-09-16T11:13:37.635 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.7-1643-gd75f2382-1focal [4,064 B] 2024-09-16T11:13:37.636 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.7-1643-gd75f2382-1focal [53.4 MB] 2024-09-16T11:13:40.489 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.7-1643-gd75f2382-1focal [231 kB] 2024-09-16T11:13:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.7-1643-gd75f2382-1focal [21.9 kB] 2024-09-16T11:13:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.7-1643-gd75f2382-1focal [17.2 MB] 2024-09-16T11:13:41.101 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-bharath9-testing-2024-09-13-1444-quincy/d75f23820806da622f561ee5ee7551015285993f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.7-1643-gd75f2382-1focal [80.7 kB] 2024-09-16T11:13:41.742 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 201 MB in 8s (24.7 MB/s) 2024-09-16T11:13:41.897 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-16T11:13:41.954 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-16T11:13:41.959 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-16T11:13:42.062 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T11:13:42.442 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-librbd1_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:42.566 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (17.2.7-1643-gd75f2382-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T11:13:43.287 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-librados2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:43.412 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (17.2.7-1643-gd75f2382-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T11:13:44.100 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T11:13:44.118 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-libcephfs2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:44.158 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:44.519 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2024-09-16T11:13:44.534 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-python3-rados_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:44.577 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:44.963 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T11:13:44.981 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:13:45.021 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:45.274 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T11:13:45.292 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-python3-cephfs_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:45.365 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:45.693 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T11:13:45.710 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:13:45.751 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:46.104 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T11:13:46.120 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2024-09-16T11:13:46.162 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-16T11:13:46.457 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T11:13:46.476 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-python3-rbd_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:46.515 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:46.835 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-16T11:13:46.851 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-16T11:13:46.926 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T11:13:47.287 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-16T11:13:47.303 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-16T11:13:47.346 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T11:13:47.682 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T11:13:47.701 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-16T11:13:47.749 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T11:13:48.118 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T11:13:48.134 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-16T11:13:48.176 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T11:13:48.529 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T11:13:48.545 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-16T11:13:48.587 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T11:13:49.066 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T11:13:49.085 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T11:13:49.134 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:13:49.619 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T11:13:49.637 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T11:13:49.677 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:13:50.072 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T11:13:50.090 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T11:13:50.130 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:13:50.517 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-16T11:13:50.536 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-16T11:13:50.591 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T11:13:50.936 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2024-09-16T11:13:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librgw2_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:50.994 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:51.805 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T11:13:51.822 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-python3-rgw_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:51.863 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:52.216 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0. 2024-09-16T11:13:52.236 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-16T11:13:52.274 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-16T11:13:52.552 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T11:13:52.568 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-libradosstriper1_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:52.610 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:53.072 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2024-09-16T11:13:53.088 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-ceph-common_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:53.130 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:55.669 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2024-09-16T11:13:55.686 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-ceph-base_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:13:55.738 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:56.648 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cryptography. 2024-09-16T11:13:56.666 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-16T11:13:56.706 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T11:13:57.112 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T11:13:57.132 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-16T11:13:57.170 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-16T11:13:57.506 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-packaging. 2024-09-16T11:13:57.522 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-python3-packaging_20.3-1_all.deb ... 2024-09-16T11:13:57.564 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-16T11:13:57.817 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T11:13:57.833 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-ceph-mgr-modules-core_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:13:57.883 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:13:58.264 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T11:13:58.279 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-16T11:13:58.313 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T11:13:58.641 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T11:13:58.658 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-16T11:13:58.699 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-16T11:13:59.044 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T11:13:59.060 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-python3-natsort_7.0.1-1_all.deb ... 2024-09-16T11:13:59.102 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-16T11:13:59.397 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jwt. 2024-09-16T11:13:59.416 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-16T11:13:59.456 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T11:13:59.792 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T11:13:59.807 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-7_all.deb ... 2024-09-16T11:13:59.850 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-16T11:14:00.181 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T11:14:00.195 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-16T11:14:00.236 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-16T11:14:00.522 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2024-09-16T11:14:00.541 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-16T11:14:00.605 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T11:14:00.884 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T11:14:00.899 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T11:14:00.933 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T11:14:01.253 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T11:14:01.270 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-16T11:14:01.311 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T11:14:01.648 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2024-09-16T11:14:01.663 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-16T11:14:01.775 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T11:14:02.025 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-16T11:14:02.042 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-16T11:14:02.083 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T11:14:02.416 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bs4. 2024-09-16T11:14:02.434 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-bs4_4.8.2-1_all.deb ... 2024-09-16T11:14:02.475 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-16T11:14:02.862 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T11:14:02.881 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-16T11:14:02.923 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T11:14:03.257 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T11:14:03.276 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6_all.deb ... 2024-09-16T11:14:03.315 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-16T11:14:03.601 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2024-09-16T11:14:03.617 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-16T11:14:03.659 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T11:14:03.971 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T11:14:03.989 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-16T11:14:04.029 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T11:14:04.340 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T11:14:04.358 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-16T11:14:04.398 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-16T11:14:04.701 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T11:14:04.718 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-webtest_2.0.32-2_all.deb ... 2024-09-16T11:14:04.759 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-16T11:14:05.088 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T11:14:05.106 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-16T11:14:05.146 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T11:14:05.513 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T11:14:05.528 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-16T11:14:05.571 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T11:14:05.932 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T11:14:05.948 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-libsqlite3-mod-ceph_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:05.990 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:06.351 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T11:14:06.367 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-ceph-mgr_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:06.425 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:07.654 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T11:14:07.673 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-ceph-mon_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:07.712 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:08.482 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T11:14:08.499 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-ceph-osd_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:08.540 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:10.603 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2024-09-16T11:14:10.619 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-ceph_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:11.030 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T11:14:11.049 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-ceph-fuse_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:11.088 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:11.483 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T11:14:11.498 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-ceph-mds_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:11.541 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:12.077 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2024-09-16T11:14:12.097 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-cephadm_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:12.135 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:12.530 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T11:14:12.547 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-16T11:14:12.588 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T11:14:12.933 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T11:14:12.948 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-ceph-mgr-cephadm_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:14:12.991 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:13.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T11:14:13.397 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T11:14:13.435 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T11:14:13.671 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-underscore. 2024-09-16T11:14:13.687 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-16T11:14:13.754 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T11:14:14.007 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-16T11:14:14.024 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-16T11:14:14.065 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T11:14:14.409 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2024-09-16T11:14:14.426 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2024-09-16T11:14:14.467 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-16T11:14:14.812 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T11:14:14.832 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:14:14.870 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:16.201 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-decorator. 2024-09-16T11:14:16.216 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-16T11:14:16.259 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T11:14:16.588 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-16T11:14:16.606 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-16T11:14:16.646 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T11:14:16.982 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-scipy. 2024-09-16T11:14:16.999 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-16T11:14:17.040 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-16T11:14:18.307 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-16T11:14:18.325 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-16T11:14:18.365 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T11:14:18.885 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T11:14:18.905 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2024-09-16T11:14:18.943 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-16T11:14:19.347 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T11:14:19.363 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-16T11:14:19.405 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T11:14:20.122 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T11:14:20.139 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:14:20.179 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:21.332 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T11:14:21.349 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2024-09-16T11:14:21.391 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-16T11:14:21.718 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T11:14:21.735 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-16T11:14:21.776 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T11:14:22.105 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T11:14:22.121 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-16T11:14:22.205 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T11:14:22.483 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T11:14:22.502 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2024-09-16T11:14:22.541 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-16T11:14:23.228 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T11:14:23.246 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2024-09-16T11:14:23.311 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-16T11:14:23.631 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-blinker. 2024-09-16T11:14:23.648 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-16T11:14:23.689 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T11:14:24.017 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-16T11:14:24.034 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-16T11:14:24.075 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T11:14:24.437 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T11:14:24.455 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-16T11:14:24.495 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T11:14:24.774 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T11:14:24.793 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-16T11:14:24.854 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T11:14:25.168 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T11:14:25.184 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-16T11:14:25.226 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T11:14:25.862 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T11:14:25.879 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:14:25.920 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:26.264 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T11:14:26.285 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2024-09-16T11:14:26.322 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-16T11:14:26.651 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T11:14:26.667 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T11:14:26.709 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T11:14:26.995 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2024-09-16T11:14:27.012 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T11:14:27.070 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T11:14:27.331 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2024-09-16T11:14:27.348 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2024-09-16T11:14:27.389 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-16T11:14:27.718 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T11:14:27.735 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-16T11:14:27.776 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-16T11:14:28.128 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2024-09-16T11:14:28.145 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-ceph-test_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:28.186 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:32.883 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T11:14:32.899 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-ceph-volume_17.2.7-1643-gd75f2382-1focal_all.deb ... 2024-09-16T11:14:32.940 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:33.372 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-16T11:14:33.389 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T11:14:33.430 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T11:14:33.951 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T11:14:33.967 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-libcephfs-dev_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:34.009 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:34.429 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T11:14:34.445 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-16T11:14:34.505 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T11:14:34.867 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-16T11:14:34.883 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T11:14:34.925 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T11:14:36.585 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-16T11:14:36.604 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-16T11:14:36.635 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-16T11:14:36.954 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-16T11:14:36.974 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-16T11:14:37.012 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T11:14:37.315 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-attr. 2024-09-16T11:14:37.332 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-python3-attr_19.3.0-2_all.deb ... 2024-09-16T11:14:37.373 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-16T11:14:37.734 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webencodings. 2024-09-16T11:14:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-16T11:14:37.792 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T11:14:38.120 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-html5lib. 2024-09-16T11:14:38.139 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-python3-html5lib_1.0.1-2_all.deb ... 2024-09-16T11:14:38.178 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-16T11:14:38.540 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-16T11:14:38.558 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-16T11:14:38.598 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T11:14:39.076 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T11:14:39.093 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T11:14:39.134 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T11:14:39.437 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T11:14:39.458 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2024-09-16T11:14:39.495 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-16T11:14:39.832 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T11:14:39.848 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-16T11:14:39.889 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T11:14:40.243 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2024-09-16T11:14:40.260 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-16T11:14:40.301 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T11:14:40.654 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T11:14:40.671 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-16T11:14:40.712 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T11:14:41.015 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T11:14:41.032 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-16T11:14:41.073 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T11:14:41.409 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T11:14:41.427 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2024-09-16T11:14:41.467 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-16T11:14:41.821 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T11:14:41.837 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-16T11:14:41.878 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T11:14:42.181 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T11:14:42.200 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-16T11:14:42.240 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T11:14:42.972 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2024-09-16T11:14:42.988 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-radosgw_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:43.029 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:44.783 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T11:14:44.800 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-rbd-fuse_17.2.7-1643-gd75f2382-1focal_amd64.deb ... 2024-09-16T11:14:44.841 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:45.154 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-16T11:14:45.471 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T11:14:45.597 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T11:14:45.722 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T11:14:45.942 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:46.538 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2024-09-16T11:14:46.707 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T11:14:46.858 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T11:14:47.185 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T11:14:47.444 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T11:14:47.570 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-16T11:14:47.697 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T11:14:48.033 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-16T11:14:48.451 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T11:14:48.719 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-16T11:14:48.996 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T11:14:49.271 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T11:14:49.564 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:49.849 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T11:14:50.000 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-16T11:14:50.259 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T11:14:50.519 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T11:14:50.620 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T11:14:51.013 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-16T11:14:51.305 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T11:14:51.590 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T11:14:51.925 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T11:14:52.234 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T11:14:52.585 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-16T11:14:52.853 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-16T11:14:53.146 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T11:14:53.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T11:14:53.398 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T11:14:54.037 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T11:14:54.517 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T11:14:54.852 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T11:14:55.179 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-16T11:14:55.338 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:14:55.656 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:14:55.816 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-16T11:14:56.150 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T11:14:56.272 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-16T11:14:56.377 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-16T11:14:56.645 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T11:14:56.955 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:14:57.081 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T11:14:57.215 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T11:14:57.567 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T11:14:57.860 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-16T11:14:58.136 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T11:14:58.237 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T11:14:58.513 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-16T11:14:58.806 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T11:14:59.124 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T11:14:59.474 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-16T11:14:59.743 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-16T11:14:59.869 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T11:15:00.220 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-16T11:15:00.571 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T11:15:00.697 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T11:15:00.823 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T11:15:01.149 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T11:15:01.451 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:01.576 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-16T11:15:03.034 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:03.160 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T11:15:03.286 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-16T11:15:03.662 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-16T11:15:03.963 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-16T11:15:04.273 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T11:15:04.399 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-16T11:15:04.733 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:04.859 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T11:15:05.170 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:05.295 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T11:15:05.630 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T11:15:06.677 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:06.803 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T11:15:06.929 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-16T11:15:07.055 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T11:15:07.206 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-16T11:15:07.499 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T11:15:07.641 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-16T11:15:07.926 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:08.052 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:08.321 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T11:15:08.321 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T11:15:08.770 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:08.981 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T11:15:09.274 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T11:15:09.567 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T11:15:09.928 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:10.054 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:10.180 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:10.331 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:10.457 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-16T11:15:10.775 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-16T11:15:11.077 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:11.203 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:11.354 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T11:15:12.273 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:12.826 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2024-09-16T11:15:13.186 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2024-09-16T11:15:13.379 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2024-09-16T11:15:13.455 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T11:15:13.548 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T11:15:13.864 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T11:15:14.325 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:14.476 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:14.753 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T11:15:14.753 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T11:15:15.403 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:15.809 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T11:15:16.271 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:16.500 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T11:15:16.500 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T11:15:16.964 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:17.220 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T11:15:17.220 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T11:15:17.674 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:18.168 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T11:15:18.168 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T11:15:18.609 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:18.727 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:18.861 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:19.084 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T11:15:19.084 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T11:15:19.538 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:19.697 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:20.112 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:20.234 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (17.2.7-1643-gd75f2382-1focal) ... 2024-09-16T11:15:20.344 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-16T11:15:20.496 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-16T11:15:20.789 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-16T11:15:23.774 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-16T11:15:24.372 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T11:15:24.376 DEBUG:teuthology.parallel:result is None 2024-09-16T11:15:24.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d75f23820806da622f561ee5ee7551015285993f 2024-09-16T11:15:24.520 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2024-09-16T11:15:24.545 INFO:teuthology.orchestra.run.smithi137.stdout:17.2.7-1643-gd75f2382-1focal 2024-09-16T11:15:24.545 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1643-gd75f2382-1focal 2024-09-16T11:15:24.545 INFO:teuthology.task.install:The correct ceph version 17.2.7-1643-gd75f2382-1focal is installed. 2024-09-16T11:15:24.548 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T11:15:24.548 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:24.549 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T11:15:24.560 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T11:15:24.560 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:24.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T11:15:24.619 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T11:15:24.629 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T11:15:24.629 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:24.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T11:15:24.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T11:15:24.706 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T11:15:24.706 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:24.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T11:15:24.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T11:15:24.729 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T11:15:24.806 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T11:15:24.806 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-09-16T11:15:24.822 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T11:15:24.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T11:15:24.833 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T11:15:24.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T11:15:24.856 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T11:15:24.856 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T11:15:24.856 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165', 'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic}', 'email': 'sangadi@redhat.com', 'first_in_suite': False, 'job_id': '7907165', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'}}, 'owner': 'scheduled_sangadi@teuthology', 'priority': 130, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9764, 'sha1': 'd75f23820806da622f561ee5ee7551015285993f', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-bharath9-testing-2024-09-13-1444-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd75f23820806da622f561ee5ee7551015285993f', 'targets': {'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_10:44:09', 'tube': 'smithi', 'user': 'sangadi', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T11:15:24.856 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T11:15:24.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T11:15:24.916 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:24.916 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T11:15:24.921 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T11:15:24.922 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 11:11:58.701121493 +0000 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 11:11:58.697121585 +0000 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 11:11:58.697121585 +0000 2024-09-16T11:15:24.927 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-16T11:15:24.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T11:15:24.940 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T11:15:24.940 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T11:15:24.940 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000432208 s, 1.2 MB/s 2024-09-16T11:15:24.941 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T11:15:24.991 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-16T11:15:24.999 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T11:15:24.999 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T11:15:24.999 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-09-16T11:15:24.999 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T11:15:24.999 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 11:11:59.325107134 +0000 2024-09-16T11:15:25.000 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 11:11:59.125111736 +0000 2024-09-16T11:15:25.000 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 11:11:59.125111736 +0000 2024-09-16T11:15:25.000 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-16T11:15:25.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T11:15:25.011 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T11:15:25.011 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T11:15:25.012 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000404185 s, 1.3 MB/s 2024-09-16T11:15:25.012 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T11:15:25.064 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-16T11:15:25.070 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T11:15:25.070 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T11:15:25.070 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-09-16T11:15:25.071 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T11:15:25.071 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 11:11:59.745097468 +0000 2024-09-16T11:15:25.071 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 11:11:59.549101979 +0000 2024-09-16T11:15:25.071 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 11:11:59.549101979 +0000 2024-09-16T11:15:25.071 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-16T11:15:25.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T11:15:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T11:15:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T11:15:25.083 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000422685 s, 1.2 MB/s 2024-09-16T11:15:25.084 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T11:15:25.136 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 11:12:00.173087619 +0000 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 11:11:59.957092590 +0000 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 11:11:59.957092590 +0000 2024-09-16T11:15:25.143 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2024-09-16T11:15:25.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T11:15:25.155 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T11:15:25.155 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T11:15:25.155 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000374382 s, 1.4 MB/s 2024-09-16T11:15:25.156 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T11:15:25.208 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T11:15:25.208 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T11:15:25.208 INFO:tasks.ceph:Generating config... 2024-09-16T11:15:25.209 INFO:tasks.ceph:[client] rbd default format = 1 2024-09-16T11:15:25.209 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-16T11:15:25.209 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-16T11:15:25.209 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-16T11:15:25.209 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T11:15:25.209 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T11:15:25.209 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T11:15:25.209 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T11:15:25.209 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T11:15:25.210 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T11:15:25.211 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T11:15:25.211 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T11:15:25.211 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T11:15:25.211 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T11:15:25.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T11:15:25.246 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T11:15:25.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T11:15:25.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T11:15:25.333 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.137')] 2024-09-16T11:15:25.333 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.137', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2024-09-16T11:15:25.334 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:25.334 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T11:15:25.340 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.137 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: generated fsid 29776169-9ac5-45b0-a0e5-5f4309d9b6a8 2024-09-16T11:15:25.371 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = octopus 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 0 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:fsid 29776169-9ac5-45b0-a0e5-5f4309d9b6a8 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:last_changed 2024-09-16T11:15:25.368728+0000 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-09-16T11:15:25.368728+0000 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:min_mon_release 15 (octopus) 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:election_strategy: 1 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-16T11:15:25.372 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T11:15:25.373 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T11:15:25.378 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 29776169-9ac5-45b0-a0e5-5f4309d9b6a8... 2024-09-16T11:15:25.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T11:15:25.415 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-09-16T11:15:25.415 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-09-16T11:15:25.415 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T11:15:25.415 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-09-16T11:15:25.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-09-16T11:15:25.417 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.418 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = 172.21.15.137 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: mon client directed command retry = 5 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on pool no app = False 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: ms inject socket failures = 5000 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 29776169-9ac5-45b0-a0e5-5f4309d9b6a8 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-09-16T11:15:25.419 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.420 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = stupid 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-09-16T11:15:25.421 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-09-16T11:15:25.422 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T11:15:25.422 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-09-16T11:15:25.422 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: osd shutdown pgref assert = True 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-09-16T11:15:25.423 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T11:15:25.424 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T11:15:25.425 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-09-16T11:15:25.426 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T11:15:25.427 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T11:15:25.427 INFO:teuthology.orchestra.run.smithi137.stdout: rbd default format = 1 2024-09-16T11:15:25.427 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-09-16T11:15:25.428 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T11:15:25.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T11:15:25.473 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T11:15:25.473 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:25.473 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T11:15:25.478 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:25.478 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T11:15:25.485 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:15:25.485 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:25.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T11:15:25.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T11:15:25.507 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:25.507 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:25.513 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T11:15:25.513 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T11:15:25.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T11:15:25.552 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T11:15:25.554 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T11:15:25.554 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T11:15:25.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T11:15:25.589 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T11:15:25.600 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T11:15:25.600 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-16T11:15:25.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T11:15:25.659 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T11:15:25.659 INFO:tasks.ceph:role: osd.0 2024-09-16T11:15:25.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:15:25.659 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T11:15:26.199 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T11:15:26.200 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T11:15:26.200 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T11:15:26.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-16T11:15:26.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T11:15:26.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T11:15:26.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T11:15:26.317 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T11:15:26.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T11:15:26.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T11:15:26.376 INFO:tasks.ceph:role: osd.1 2024-09-16T11:15:26.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:15:26.376 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T11:15:26.865 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-16T11:15:26.866 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T11:15:26.866 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T11:15:26.866 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T11:15:26.866 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T11:15:26.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-16T11:15:26.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T11:15:26.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T11:15:26.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T11:15:26.916 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T11:15:26.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T11:15:26.927 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T11:15:26.927 INFO:tasks.ceph:role: osd.2 2024-09-16T11:15:26.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:15:26.927 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T11:15:27.446 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T11:15:27.446 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T11:15:27.446 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T11:15:27.447 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T11:15:27.448 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-16T11:15:27.448 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T11:15:27.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T11:15:27.512 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T11:15:27.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T11:15:27.513 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:27.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.579+0000 7fce15227540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T11:15:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.583+0000 7fce15227540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T11:15:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.583+0000 7fce15227540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T11:15:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.583+0000 7fce15227540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T11:15:27.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.583+0000 7fce15227540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T11:15:27.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:27.587+0000 7fce15227540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T11:15:28.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:28.163+0000 7fce15227540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:28.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:28.942+0000 7fce15227540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:29.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:29.722+0000 7fce15227540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:30.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T11:15:30.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:30.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.618+0000 7f651403a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T11:15:30.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.618+0000 7f651403a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T11:15:30.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.618+0000 7f651403a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T11:15:30.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.618+0000 7f651403a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T11:15:30.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.618+0000 7f651403a540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T11:15:30.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:30.622+0000 7f651403a540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T11:15:31.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:31.174+0000 7f651403a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:31.958+0000 7f651403a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:32.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:32.750+0000 7f651403a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:33.595 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T11:15:33.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:33.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.686+0000 7f44dcfa5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T11:15:33.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.686+0000 7f44dcfa5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T11:15:33.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.686+0000 7f44dcfa5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T11:15:33.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.686+0000 7f44dcfa5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T11:15:33.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.690+0000 7f44dcfa5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T11:15:33.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:33.690+0000 7f44dcfa5540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T11:15:34.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:34.250+0000 7f44dcfa5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:35.026+0000 7f44dcfa5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:35.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:35.810+0000 7f44dcfa5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-09-16T11:15:36.674 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T11:15:36.689 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T11:15:36.689 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:36.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T11:15:36.747 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:36.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T11:15:36.757 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:36.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T11:15:36.772 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:36.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T11:15:36.831 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:36.832 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T11:15:36.836 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T11:15:36.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T11:15:36.850 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBNE+hmNTm/IBAALPhICmHk8Xf9cID9Ehxv4g== 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBPE+hm+qbbIhAA6F4ddiC9yDVkRCFpzREhFQ== 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBSE+hm1XU4JRAArf9v/3mAxBnMOGsr1jnQ/g== 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBVE+hm+sNJKRAAgjO2UsvJYXdgdo4vDbdeCg== 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-16T11:15:36.851 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBNE+hmb5/6IhAAZGrNUih8CzQ1+yDyuA9zFQ== 2024-09-16T11:15:36.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T11:15:36.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T11:15:36.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T11:15:37.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T11:15:37.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T11:15:37.107 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T11:15:37.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T11:15:37.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T11:15:37.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T11:15:37.229 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T11:15:37.236 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T11:15:37.236 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T11:15:37.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T11:15:37.238 INFO:tasks.ceph.mon.a:Started 2024-09-16T11:15:37.238 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T11:15:37.238 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T11:15:37.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T11:15:37.241 INFO:tasks.ceph.mgr.x:Started 2024-09-16T11:15:37.241 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T11:15:37.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T11:15:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-09-16T11:15:37.478 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T11:15:37.478 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:37.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T11:15:37.488 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:37.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T11:15:37.544 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:15:37.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T11:15:37.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new 5d95f1dd-6d95-4053-849a-d86b0644797f 0 2024-09-16T11:15:37.573 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:37.566+0000 7fad01ae3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T11:15:37.750 INFO:teuthology.orchestra.run.smithi137.stdout:0 2024-09-16T11:15:37.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new cb66ef56-46ea-4662-aaa6-7aeceb0f5b65 1 2024-09-16T11:15:38.003 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-09-16T11:15:38.015 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd new e77353b1-a6fe-4906-b299-7714b0bb6d08 2 2024-09-16T11:15:38.204 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-09-16T11:15:38.216 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T11:15:38.216 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T11:15:38.218 INFO:tasks.ceph.osd.0:Started 2024-09-16T11:15:38.218 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T11:15:38.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T11:15:38.220 INFO:tasks.ceph.osd.1:Started 2024-09-16T11:15:38.221 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T11:15:38.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T11:15:38.223 INFO:tasks.ceph.osd.2:Started 2024-09-16T11:15:38.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:38.273 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.266+0000 7fad01ae3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T11:15:38.342 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.334+0000 7fad01ae3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T11:15:38.457 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.450+0000 7fad01ae3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T11:15:38.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T11:15:38.534+0000 7fc0e659c700 0 --2- 172.21.15.137:0/3433508574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0e811bcd0 0x7fc0e8118a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T11:15:38.615 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:38.615 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:38.199666+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:38.625 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T11:15:38.626 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T11:15:38.681 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.674+0000 7fad01ae3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T11:15:38.728 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.722+0000 7fad01ae3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T11:15:38.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:15:38.846+0000 7fd048c65540 -1 Falling back to public interface 2024-09-16T11:15:38.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:15:38.846+0000 7fd34422a540 -1 Falling back to public interface 2024-09-16T11:15:38.866 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-16T11:15:38.858+0000 7f56819f2540 -1 Falling back to public interface 2024-09-16T11:15:38.898 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.890+0000 7fad01ae3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T11:15:38.928 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:38.958 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:38.950+0000 7fad01ae3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T11:15:39.021 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:39.014+0000 7fad01ae3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T11:15:39.099 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-16T11:15:39.099 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":5,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:38.199666+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:39.115 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T11:15:39.453 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:39.446+0000 7fad01ae3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T11:15:39.558 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:39.550+0000 7fad01ae3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T11:15:39.850 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:39.842+0000 7fad01ae3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T11:15:40.015 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.006+0000 7fad01ae3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T11:15:40.082 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.074+0000 7fad01ae3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T11:15:40.134 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.126+0000 7fad01ae3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T11:15:40.193 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.186+0000 7fad01ae3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T11:15:40.366 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.358+0000 7fad01ae3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T11:15:40.532 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.526+0000 7fad01ae3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T11:15:40.598 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.590+0000 7fad01ae3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T11:15:40.758 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.750+0000 7fad01ae3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T11:15:40.825 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:40.818+0000 7fad01ae3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T11:15:41.533 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:41.526+0000 7fad01ae3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T11:15:42.568 INFO:tasks.ceph.mgr.x.smithi137.stderr:2024-09-16T11:15:42.562+0000 7faceab57700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T11:15:42.706 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-16T11:15:42.698+0000 7f56819f2540 -1 osd.2 0 log_to_monitors true 2024-09-16T11:15:42.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:15:42.714+0000 7fd048c65540 -1 osd.0 0 log_to_monitors true 2024-09-16T11:15:42.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:15:42.714+0000 7fd34422a540 -1 osd.1 0 log_to_monitors true 2024-09-16T11:15:45.418 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:45.721 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-16T11:15:45.721 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":7,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:44.613225+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:45.735 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-16T11:15:46.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:15:46.742+0000 7fd33f9ca700 -1 osd.1 0 waiting for initial osdmap 2024-09-16T11:15:46.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:15:46.750+0000 7fd33876d700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T11:15:46.759 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-16T11:15:46.754+0000 7f567d192700 -1 osd.2 0 waiting for initial osdmap 2024-09-16T11:15:46.767 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-09-16T11:15:46.758+0000 7f5675f35700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T11:15:46.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:15:46.794+0000 7fd044405700 -1 osd.0 0 waiting for initial osdmap 2024-09-16T11:15:46.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:15:46.798+0000 7fd03d1a8700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T11:15:52.038 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:52.324 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-16T11:15:52.324 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":11,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:51.639495+0000","last_up_change":"2024-09-16T11:15:47.757879+0000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T11:15:49.622679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":20976},{"type":"v1","addr":"172.21.15.137:6801","nonce":20976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":20976},{"type":"v1","addr":"172.21.15.137:6804","nonce":20976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":20976},{"type":"v1","addr":"172.21.15.137:6814","nonce":20976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":20976},{"type":"v1","addr":"172.21.15.137:6809","nonce":20976}]},"public_addr":"172.21.15.137:6801/20976","cluster_addr":"172.21.15.137:6804/20976","heartbeat_back_addr":"172.21.15.137:6814/20976","heartbeat_front_addr":"172.21.15.137:6809/20976","state":["exists","up"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":20975},{"type":"v1","addr":"172.21.15.137:6805","nonce":20975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":20975},{"type":"v1","addr":"172.21.15.137:6808","nonce":20975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":20975},{"type":"v1","addr":"172.21.15.137:6815","nonce":20975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":20975},{"type":"v1","addr":"172.21.15.137:6811","nonce":20975}]},"public_addr":"172.21.15.137:6805/20975","cluster_addr":"172.21.15.137:6808/20975","heartbeat_back_addr":"172.21.15.137:6815/20975","heartbeat_front_addr":"172.21.15.137:6811/20975","state":["exists","up"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":20977},{"type":"v1","addr":"172.21.15.137:6817","nonce":20977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":20977},{"type":"v1","addr":"172.21.15.137:6819","nonce":20977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":20977},{"type":"v1","addr":"172.21.15.137:6823","nonce":20977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":20977},{"type":"v1","addr":"172.21.15.137:6821","nonce":20977}]},"public_addr":"172.21.15.137:6817/20977","cluster_addr":"172.21.15.137:6819/20977","heartbeat_back_addr":"172.21.15.137:6823/20977","heartbeat_front_addr":"172.21.15.137:6821/20977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.716173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.679354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.717390+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:52.336 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-16T11:15:52.337 INFO:tasks.ceph:Creating RBD pool 2024-09-16T11:15:52.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T11:15:52.938 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'rbd' created 2024-09-16T11:15:52.951 DEBUG:teuthology.orchestra.run.smithi137:> rbd --cluster ceph pool init rbd 2024-09-16T11:15:55.972 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T11:15:55.972 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T11:15:55.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T11:15:55.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T11:15:55.973 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T11:15:56.309 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:56.321 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":20792},{"type":"v1","addr":"172.21.15.137:6825","nonce":20792}]},"active_addr":"172.21.15.137:6825/20792","active_change":"2024-09-16T11:15:41.550998+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3684041264}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":2200541166}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":3823113922}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":679305939}]}]} 2024-09-16T11:15:56.323 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T11:15:56.324 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T11:15:56.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:56.613 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:56.613 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":15,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:55.941152+0000","last_up_change":"2024-09-16T11:15:47.757879+0000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T11:15:49.622679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T11:15:52.662555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":20976},{"type":"v1","addr":"172.21.15.137:6801","nonce":20976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":20976},{"type":"v1","addr":"172.21.15.137:6804","nonce":20976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":20976},{"type":"v1","addr":"172.21.15.137:6814","nonce":20976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":20976},{"type":"v1","addr":"172.21.15.137:6809","nonce":20976}]},"public_addr":"172.21.15.137:6801/20976","cluster_addr":"172.21.15.137:6804/20976","heartbeat_back_addr":"172.21.15.137:6814/20976","heartbeat_front_addr":"172.21.15.137:6809/20976","state":["exists","up"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":20975},{"type":"v1","addr":"172.21.15.137:6805","nonce":20975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":20975},{"type":"v1","addr":"172.21.15.137:6808","nonce":20975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":20975},{"type":"v1","addr":"172.21.15.137:6815","nonce":20975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":20975},{"type":"v1","addr":"172.21.15.137:6811","nonce":20975}]},"public_addr":"172.21.15.137:6805/20975","cluster_addr":"172.21.15.137:6808/20975","heartbeat_back_addr":"172.21.15.137:6815/20975","heartbeat_front_addr":"172.21.15.137:6811/20975","state":["exists","up"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":20977},{"type":"v1","addr":"172.21.15.137:6817","nonce":20977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":20977},{"type":"v1","addr":"172.21.15.137:6819","nonce":20977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":20977},{"type":"v1","addr":"172.21.15.137:6823","nonce":20977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":20977},{"type":"v1","addr":"172.21.15.137:6821","nonce":20977}]},"public_addr":"172.21.15.137:6817/20977","cluster_addr":"172.21.15.137:6819/20977","heartbeat_back_addr":"172.21.15.137:6823/20977","heartbeat_front_addr":"172.21.15.137:6821/20977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.716173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.679354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.717390+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:56.630 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T11:15:56.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T11:15:56.918 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:56.918 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":15,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T11:15:55.941152+0000","last_up_change":"2024-09-16T11:15:47.757879+0000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T11:15:49.622679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T11:15:52.662555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":20976},{"type":"v1","addr":"172.21.15.137:6801","nonce":20976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":20976},{"type":"v1","addr":"172.21.15.137:6804","nonce":20976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":20976},{"type":"v1","addr":"172.21.15.137:6814","nonce":20976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":20976},{"type":"v1","addr":"172.21.15.137:6809","nonce":20976}]},"public_addr":"172.21.15.137:6801/20976","cluster_addr":"172.21.15.137:6804/20976","heartbeat_back_addr":"172.21.15.137:6814/20976","heartbeat_front_addr":"172.21.15.137:6809/20976","state":["exists","up"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":20975},{"type":"v1","addr":"172.21.15.137:6805","nonce":20975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":20975},{"type":"v1","addr":"172.21.15.137:6808","nonce":20975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":20975},{"type":"v1","addr":"172.21.15.137:6815","nonce":20975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":20975},{"type":"v1","addr":"172.21.15.137:6811","nonce":20975}]},"public_addr":"172.21.15.137:6805/20975","cluster_addr":"172.21.15.137:6808/20975","heartbeat_back_addr":"172.21.15.137:6815/20975","heartbeat_front_addr":"172.21.15.137:6811/20975","state":["exists","up"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":20977},{"type":"v1","addr":"172.21.15.137:6817","nonce":20977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":20977},{"type":"v1","addr":"172.21.15.137:6819","nonce":20977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":20977},{"type":"v1","addr":"172.21.15.137:6823","nonce":20977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":20977},{"type":"v1","addr":"172.21.15.137:6821","nonce":20977}]},"public_addr":"172.21.15.137:6817/20977","cluster_addr":"172.21.15.137:6819/20977","heartbeat_back_addr":"172.21.15.137:6823/20977","heartbeat_front_addr":"172.21.15.137:6821/20977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.716173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.679354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.717390+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T11:15:56.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T11:15:56.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T11:15:56.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T11:15:57.066 INFO:teuthology.orchestra.run.smithi137.stdout:34359738373 2024-09-16T11:15:57.066 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T11:15:57.072 INFO:teuthology.orchestra.run.smithi137.stdout:34359738374 2024-09-16T11:15:57.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T11:15:57.077 INFO:teuthology.orchestra.run.smithi137.stdout:34359738372 2024-09-16T11:15:57.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T11:15:57.345 INFO:teuthology.orchestra.run.smithi137.stdout:34359738371 2024-09-16T11:15:57.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2024-09-16T11:15:57.359 INFO:teuthology.orchestra.run.smithi137.stdout:34359738372 2024-09-16T11:15:57.360 INFO:teuthology.orchestra.run.smithi137.stdout:34359738373 2024-09-16T11:15:57.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-09-16T11:15:57.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-09-16T11:15:58.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T11:15:58.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T11:15:58.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T11:15:58.656 INFO:teuthology.orchestra.run.smithi137.stdout:34359738372 2024-09-16T11:15:58.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2024-09-16T11:15:58.674 DEBUG:teuthology.parallel:result is None 2024-09-16T11:15:58.702 INFO:teuthology.orchestra.run.smithi137.stdout:34359738373 2024-09-16T11:15:58.714 INFO:teuthology.orchestra.run.smithi137.stdout:34359738374 2024-09-16T11:15:58.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-09-16T11:15:58.715 DEBUG:teuthology.parallel:result is None 2024-09-16T11:15:58.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-09-16T11:15:58.733 DEBUG:teuthology.parallel:result is None 2024-09-16T11:15:58.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T11:15:58.733 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T11:15:59.017 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:59.020 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T11:15:59.031 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-16T11:15:57.562604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":897784,"kb_used_data":1548,"kb_used_omap":4,"kb_used_meta":896187,"kb_avail":282217736,"statfs":{"total":289910292480,"available":288990961664,"internally_reserved":0,"allocated":1585152,"data_stored":1294538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":917695496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.629111"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961288+0000","last_change":"2024-09-16T11:15:55.961577+0000","last_active":"2024-09-16T11:15:55.961288+0000","last_peered":"2024-09-16T11:15:55.961288+0000","last_clean":"2024-09-16T11:15:55.961288+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T11:15:55.961288+0000","last_undegraded":"2024-09-16T11:15:55.961288+0000","last_fullsized":"2024-09-16T11:15:55.961288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010350979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.960838+0000","last_change":"2024-09-16T11:15:55.961155+0000","last_active":"2024-09-16T11:15:55.960838+0000","last_peered":"2024-09-16T11:15:55.960838+0000","last_clean":"2024-09-16T11:15:55.960838+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T11:15:55.960838+0000","last_undegraded":"2024-09-16T11:15:55.960838+0000","last_fullsized":"2024-09-16T11:15:55.960838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065856400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961692+0000","last_change":"2024-09-16T11:15:55.962015+0000","last_active":"2024-09-16T11:15:55.961692+0000","last_peered":"2024-09-16T11:15:55.961692+0000","last_clean":"2024-09-16T11:15:55.961692+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T11:15:55.961692+0000","last_undegraded":"2024-09-16T11:15:55.961692+0000","last_fullsized":"2024-09-16T11:15:55.961692+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961358+0000","last_change":"2024-09-16T11:15:55.961771+0000","last_active":"2024-09-16T11:15:55.961358+0000","last_peered":"2024-09-16T11:15:55.961358+0000","last_clean":"2024-09-16T11:15:55.961358+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T11:15:55.961358+0000","last_undegraded":"2024-09-16T11:15:55.961358+0000","last_fullsized":"2024-09-16T11:15:55.961358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010660940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.957957+0000","last_change":"2024-09-16T11:15:55.957957+0000","last_active":"2024-09-16T11:15:55.957957+0000","last_peered":"2024-09-16T11:15:55.957957+0000","last_clean":"2024-09-16T11:15:55.957957+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T11:15:55.957957+0000","last_undegraded":"2024-09-16T11:15:55.957957+0000","last_fullsized":"2024-09-16T11:15:55.957957+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018421869999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.953428+0000","last_change":"2024-09-16T11:15:55.953851+0000","last_active":"2024-09-16T11:15:55.953428+0000","last_peered":"2024-09-16T11:15:55.953428+0000","last_clean":"2024-09-16T11:15:55.953428+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T11:15:55.953428+0000","last_undegraded":"2024-09-16T11:15:55.953428+0000","last_fullsized":"2024-09-16T11:15:55.953428+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065938100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.953530+0000","last_change":"2024-09-16T11:15:55.953910+0000","last_active":"2024-09-16T11:15:55.953530+0000","last_peered":"2024-09-16T11:15:55.953530+0000","last_clean":"2024-09-16T11:15:55.953530+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T11:15:55.953530+0000","last_undegraded":"2024-09-16T11:15:55.953530+0000","last_fullsized":"2024-09-16T11:15:55.953530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072960699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.960687+0000","last_change":"2024-09-16T11:15:55.961147+0000","last_active":"2024-09-16T11:15:55.960687+0000","last_peered":"2024-09-16T11:15:55.960687+0000","last_clean":"2024-09-16T11:15:55.960687+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T11:15:55.960687+0000","last_undegraded":"2024-09-16T11:15:55.960687+0000","last_fullsized":"2024-09-16T11:15:55.960687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070868500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":80,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T11:15:54.938297+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T11:15:54.938297+0000","last_peered":"2024-09-16T11:15:54.938297+0000","last_clean":"2024-09-16T11:15:54.938297+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T11:15:54.938297+0000","last_undegraded":"2024-09-16T11:15:54.938297+0000","last_fullsized":"2024-09-16T11:15:54.938297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":131072,"data_stored":38175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":729088,"data_stored":628562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":724992,"data_stored":627801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T11:15:59.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T11:15:59.311 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:59.314 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T11:15:59.325 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-16T11:15:57.562604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":897784,"kb_used_data":1548,"kb_used_omap":4,"kb_used_meta":896187,"kb_avail":282217736,"statfs":{"total":289910292480,"available":288990961664,"internally_reserved":0,"allocated":1585152,"data_stored":1294538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":917695496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.629111"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961288+0000","last_change":"2024-09-16T11:15:55.961577+0000","last_active":"2024-09-16T11:15:55.961288+0000","last_peered":"2024-09-16T11:15:55.961288+0000","last_clean":"2024-09-16T11:15:55.961288+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T11:15:55.961288+0000","last_undegraded":"2024-09-16T11:15:55.961288+0000","last_fullsized":"2024-09-16T11:15:55.961288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010350979999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.960838+0000","last_change":"2024-09-16T11:15:55.961155+0000","last_active":"2024-09-16T11:15:55.960838+0000","last_peered":"2024-09-16T11:15:55.960838+0000","last_clean":"2024-09-16T11:15:55.960838+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T11:15:55.960838+0000","last_undegraded":"2024-09-16T11:15:55.960838+0000","last_fullsized":"2024-09-16T11:15:55.960838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065856400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961692+0000","last_change":"2024-09-16T11:15:55.962015+0000","last_active":"2024-09-16T11:15:55.961692+0000","last_peered":"2024-09-16T11:15:55.961692+0000","last_clean":"2024-09-16T11:15:55.961692+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T11:15:55.961692+0000","last_undegraded":"2024-09-16T11:15:55.961692+0000","last_fullsized":"2024-09-16T11:15:55.961692+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.961358+0000","last_change":"2024-09-16T11:15:55.961771+0000","last_active":"2024-09-16T11:15:55.961358+0000","last_peered":"2024-09-16T11:15:55.961358+0000","last_clean":"2024-09-16T11:15:55.961358+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T11:15:55.961358+0000","last_undegraded":"2024-09-16T11:15:55.961358+0000","last_fullsized":"2024-09-16T11:15:55.961358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010660940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"15'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.957957+0000","last_change":"2024-09-16T11:15:55.957957+0000","last_active":"2024-09-16T11:15:55.957957+0000","last_peered":"2024-09-16T11:15:55.957957+0000","last_clean":"2024-09-16T11:15:55.957957+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T11:15:55.957957+0000","last_undegraded":"2024-09-16T11:15:55.957957+0000","last_fullsized":"2024-09-16T11:15:55.957957+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018421869999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.953428+0000","last_change":"2024-09-16T11:15:55.953851+0000","last_active":"2024-09-16T11:15:55.953428+0000","last_peered":"2024-09-16T11:15:55.953428+0000","last_clean":"2024-09-16T11:15:55.953428+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T11:15:55.953428+0000","last_undegraded":"2024-09-16T11:15:55.953428+0000","last_fullsized":"2024-09-16T11:15:55.953428+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065938100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.953530+0000","last_change":"2024-09-16T11:15:55.953910+0000","last_active":"2024-09-16T11:15:55.953530+0000","last_peered":"2024-09-16T11:15:55.953530+0000","last_clean":"2024-09-16T11:15:55.953530+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T11:15:55.953530+0000","last_undegraded":"2024-09-16T11:15:55.953530+0000","last_fullsized":"2024-09-16T11:15:55.953530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072960699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"13'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-16T11:15:55.960687+0000","last_change":"2024-09-16T11:15:55.961147+0000","last_active":"2024-09-16T11:15:55.960687+0000","last_peered":"2024-09-16T11:15:55.960687+0000","last_clean":"2024-09-16T11:15:55.960687+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T11:15:55.960687+0000","last_undegraded":"2024-09-16T11:15:55.960687+0000","last_fullsized":"2024-09-16T11:15:55.960687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070868500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"10'52","reported_seq":80,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T11:15:54.938297+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T11:15:54.938297+0000","last_peered":"2024-09-16T11:15:54.938297+0000","last_clean":"2024-09-16T11:15:54.938297+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T11:15:54.938297+0000","last_undegraded":"2024-09-16T11:15:54.938297+0000","last_fullsized":"2024-09-16T11:15:54.938297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":131072,"data_stored":38175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":729088,"data_stored":628562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302228,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069612,"statfs":{"total":96636764160,"available":96327282688,"internally_reserved":0,"allocated":724992,"data_stored":627801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T11:15:59.326 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T11:15:59.326 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T11:15:59.326 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T11:15:59.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T11:15:59.652 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T11:15:59.653 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T11:15:59.666 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T11:15:59.666 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T11:15:59.677 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T11:15:59.677 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T11:15:59.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2024-09-16T11:16:00.982 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cache' created 2024-09-16T11:16:00.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2024-09-16T11:16:01.988 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2024-09-16T11:16:02.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2024-09-16T11:16:02.334 INFO:teuthology.orchestra.run.smithi137.stderr:set cache-mode for pool 'cache' to writeback 2024-09-16T11:16:02.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2024-09-16T11:16:03.339 INFO:teuthology.orchestra.run.smithi137.stderr:overlay for 'rbd' is now (or already was) 'cache' 2024-09-16T11:16:03.355 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2024-09-16T11:16:04.345 INFO:teuthology.orchestra.run.smithi137.stderr:set pool 3 hit_set_type to bloom 2024-09-16T11:16:04.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2024-09-16T11:16:05.348 INFO:teuthology.orchestra.run.smithi137.stderr:set pool 3 hit_set_count to 8 2024-09-16T11:16:05.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2024-09-16T11:16:06.354 INFO:teuthology.orchestra.run.smithi137.stderr:set pool 3 hit_set_period to 60 2024-09-16T11:16:06.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2024-09-16T11:16:07.366 INFO:teuthology.orchestra.run.smithi137.stderr:set pool 3 target_max_objects to 250 2024-09-16T11:16:07.380 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T11:16:07.394 INFO:tasks.workunit:Pulling workunits from ref d75f23820806da622f561ee5ee7551015285993f 2024-09-16T11:16:07.395 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T11:16:07.395 DEBUG:teuthology.orchestra.run.smithi137:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T11:16:07.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T11:16:07.403 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T11:16:07.403 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T11:16:07.409 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T11:16:07.410 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T11:16:07.414 INFO:tasks.workunit:timeout=3h 2024-09-16T11:16:07.414 INFO:tasks.workunit:cleanup=True 2024-09-16T11:16:07.415 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d75f23820806da622f561ee5ee7551015285993f 2024-09-16T11:16:07.423 INFO:tasks.workunit.client.0.smithi137.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T11:16:58.995 INFO:tasks.workunit.client.0.smithi137.stderr:Note: switching to 'd75f23820806da622f561ee5ee7551015285993f'. 2024-09-16T11:16:58.995 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.995 INFO:tasks.workunit.client.0.smithi137.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T11:16:58.995 INFO:tasks.workunit.client.0.smithi137.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: git switch -c 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr:Or undo this operation with: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: git switch - 2024-09-16T11:16:58.996 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.997 INFO:tasks.workunit.client.0.smithi137.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T11:16:58.997 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:16:58.997 INFO:tasks.workunit.client.0.smithi137.stderr:HEAD is now at d75f2382080 Merge branch 'wip-67762-quincy' of https://github.com/nbalacha/ceph into wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-16T11:16:59.000 DEBUG:teuthology.orchestra.run.smithi137:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T11:16:59.062 INFO:tasks.workunit.client.0.smithi137.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T11:16:59.066 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T11:16:59.066 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T11:16:59.939 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T11:17:00.045 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T11:17:00.100 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T11:17:00.103 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T11:17:00.103 INFO:tasks.workunit.client.0.smithi137.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T11:17:00.158 INFO:tasks.workunit.client.0.smithi137.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T11:17:00.163 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T11:17:00.163 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T11:17:00.170 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2024-09-16T11:17:00.171 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2024-09-16T11:17:00.171 DEBUG:teuthology.orchestra.run.smithi137:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-09-16T11:17:00.183 INFO:tasks.workunit.client.0.smithi137.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-09-16T11:17:00.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2024-09-16T11:17:00.185 INFO:tasks.workunit.client.0.smithi137.stderr:++ TIMEOUT=300 2024-09-16T11:17:00.185 INFO:tasks.workunit.client.0.smithi137.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ MAX_TIMEOUT=15 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ PG_NUM=4 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ TMPDIR=/tmp 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ TESTDIR=/home/ubuntu/cephtest 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ type xmlstarlet 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:++ XMLSTARLET=xmlstarlet 2024-09-16T11:17:00.186 INFO:tasks.workunit.client.0.smithi137.stderr:+++ uname 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' Linux = FreeBSD ']' 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:++ SED=sed 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:++ AWK=awk 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:+++ stty -a 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:+++ head -1 2024-09-16T11:17:00.187 INFO:tasks.workunit.client.0.smithi137.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2024-09-16T11:17:00.192 INFO:tasks.workunit.client.0.smithi137.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T11:17:00.193 INFO:tasks.workunit.client.0.smithi137.stderr:++ termwidth= 2024-09-16T11:17:00.193 INFO:tasks.workunit.client.0.smithi137.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2024-09-16T11:17:00.193 INFO:tasks.workunit.client.0.smithi137.stderr:++ DIFFCOLOPTS='-y ' 2024-09-16T11:17:00.193 INFO:tasks.workunit.client.0.smithi137.stderr:++ KERNCORE=kernel.core_pattern 2024-09-16T11:17:00.193 INFO:tasks.workunit.client.0.smithi137.stderr:++ EXTRA_OPTS= 2024-09-16T11:17:00.203 INFO:tasks.workunit.client.0.smithi137.stderr:++ test '' = TESTS 2024-09-16T11:17:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ export RBD_FORCE_ALLOW_V1=1 2024-09-16T11:17:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ RBD_FORCE_ALLOW_V1=1 2024-09-16T11:17:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:00.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v '^0$' 2024-09-16T11:17:00.237 INFO:tasks.workunit.client.0.smithi137.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2024-09-16T11:17:00.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ tiered=0 2024-09-16T11:17:00.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd dump 2024-09-16T11:17:00.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^pool' 2024-09-16T11:17:00.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ''\''rbd'\''' 2024-09-16T11:17:00.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep tier 2024-09-16T11:17:00.586 INFO:tasks.workunit.client.0.smithi137.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 lfor 19/19/19 flags hashpspool,selfmanaged_snaps tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2024-09-16T11:17:00.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ tiered=1 2024-09-16T11:17:00.601 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_pool_image_args 2024-09-16T11:17:00.601 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing pool and image args...' 2024-09-16T11:17:00.602 INFO:tasks.workunit.client.0.smithi137.stdout:testing pool and image args... 2024-09-16T11:17:00.602 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:17:00.602 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:00.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:00.817 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:00.934 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.050 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.166 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.400 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.717 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.834 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:01.953 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.069 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.186 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.420 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.640 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.756 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:02.875 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T11:17:03.277 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'test' does not exist 2024-09-16T11:17:03.285 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool create test 32 2024-09-16T11:17:03.752 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'test' already exists 2024-09-16T11:17:03.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd pool init test 2024-09-16T11:17:06.676 INFO:tasks.workunit.client.0.smithi137.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2024-09-16T11:17:06.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:06.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:06.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:17:06.729 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:17:06.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 1 test1 2024-09-16T11:17:06.763 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:06.758+0000 7fd1cafc04c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:08.704 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:08.704 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test1 2024-09-16T11:17:08.741 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import --image test2 /tmp/empty 2024-09-16T11:17:08.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:08.770+0000 7fe28fe794c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:08.796 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:08.796 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:08.801 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:08.801 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test2 2024-09-16T11:17:08.843 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --dest test3 import /tmp/empty 2024-09-16T11:17:08.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:08.878+0000 7f4eb60264c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:08.906 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:08.911 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:08.911 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test3 2024-09-16T11:17:08.954 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import /tmp/empty foo 2024-09-16T11:17:08.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:08.986+0000 7ff1f8a914c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:09.014 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:09.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:09.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q foo 2024-09-16T11:17:09.065 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2024-09-16T11:17:09.092 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-16T11:17:09.093 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:17:09.093 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import /tmp/empty test/empty@snap 2024-09-16T11:17:09.119 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-16T11:17:09.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:17:09.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import --image test/empty@snap /tmp/empty 2024-09-16T11:17:09.148 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-16T11:17:09.148 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:09.150 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:17:09.150 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import /tmp/empty@snap 2024-09-16T11:17:09.173 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2024-09-16T11:17:09.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:17:09.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:09.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:09.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:17:09.217 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:17:09.218 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import /tmp/empty test/test1 2024-09-16T11:17:09.256 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:09.250+0000 7f99bd95b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:10.721 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:10.726 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test1 2024-09-16T11:17:10.726 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:10.768 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p test import /tmp/empty test2 2024-09-16T11:17:10.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:10.802+0000 7f8d5d7a14c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:10.826 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:10.826 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-16T11:17:10.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:10.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test2 2024-09-16T11:17:10.874 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --image test3 -p test import /tmp/empty 2024-09-16T11:17:10.919 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:10.914+0000 7f288ae9b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:10.937 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:10.938 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:10.938 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-16T11:17:10.943 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test3 2024-09-16T11:17:10.943 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:10.985 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --image test4 -p test import /tmp/empty 2024-09-16T11:17:11.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.022+0000 7fa2133ca4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.051 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.052 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:11.052 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-16T11:17:11.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test4 2024-09-16T11:17:11.100 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --dest test5 -p test import /tmp/empty 2024-09-16T11:17:11.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.138+0000 7f9043af94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.163 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.163 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-16T11:17:11.168 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.168 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test5 2024-09-16T11:17:11.413 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2024-09-16T11:17:11.458 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.450+0000 7fc5f68914c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.483 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.489 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.489 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test6 2024-09-16T11:17:11.532 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2024-09-16T11:17:11.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.570+0000 7fcf4e8244c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.598 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.599 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:11.603 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test7 2024-09-16T11:17:11.648 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --image test/test8 import /tmp/empty 2024-09-16T11:17:11.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.682+0000 7fd27c9ad4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.708 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.709 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: --image is deprecated, use --dest 2024-09-16T11:17:11.714 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.714 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test8 2024-09-16T11:17:11.759 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --dest test/test9 import /tmp/empty 2024-09-16T11:17:11.798 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.790+0000 7f86454414c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.818 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.824 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.824 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test9 2024-09-16T11:17:11.868 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import --pool test /tmp/empty 2024-09-16T11:17:11.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:11.902+0000 7f673e5d44c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:11.926 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:17:11.927 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2024-09-16T11:17:11.932 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:11.932 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q empty 2024-09-16T11:17:11.975 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy test/test9 test10 2024-09-16T11:17:12.061 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:17:12.068 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:12.068 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -qv test10 2024-09-16T11:17:12.113 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:12.113 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test10 2024-09-16T11:17:12.152 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy test/test9 test/test10 2024-09-16T11:17:12.240 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:17:12.246 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:12.246 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test10 2024-09-16T11:17:12.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2024-09-16T11:17:12.386 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:17:12.391 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:12.391 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -q test11 2024-09-16T11:17:12.437 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2024-09-16T11:17:12.531 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:17:12.537 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:12.537 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test12 2024-09-16T11:17:12.579 INFO:tasks.workunit.client.0.smithi137.stdout:test12 2024-09-16T11:17:12.579 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls test 2024-09-16T11:17:12.580 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -qv test12 2024-09-16T11:17:12.623 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2024-09-16T11:17:12.625 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T11:17:13.460 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'test' does not exist 2024-09-16T11:17:13.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm foo 2024-09-16T11:17:13.531 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:13.534 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.534 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:17:13.589 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:13.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test10 2024-09-16T11:17:13.731 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:13.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test12 2024-09-16T11:17:13.876 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:13.881 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.881 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:17:13.943 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:13.948 INFO:tasks.workunit.client.0.smithi137.stderr:+ for f in foo test1 test10 test12 test2 test3 2024-09-16T11:17:13.948 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test3 2024-09-16T11:17:14.011 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:14.016 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_rename 2024-09-16T11:17:14.016 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing rename...' 2024-09-16T11:17:14.016 INFO:tasks.workunit.client.0.smithi137.stdout:testing rename... 2024-09-16T11:17:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:17:14.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.131 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.246 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.362 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.709 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:14.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.047 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.278 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.397 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.516 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.636 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.752 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.870 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:15.986 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:16.104 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 foo 2024-09-16T11:17:16.133 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:17:16.149 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:16.138+0000 7f47460d24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:16.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 bar 2024-09-16T11:17:16.227 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename foo foo2 2024-09-16T11:17:16.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename foo2 bar 2024-09-16T11:17:16.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep exists 2024-09-16T11:17:16.357 INFO:tasks.workunit.client.0.smithi137.stdout:2024-09-16T11:17:16.342+0000 7f9c802724c0 -1 librbd::Operations: rbd image bar already exists 2024-09-16T11:17:16.357 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: rename error: (17) File exists 2024-09-16T11:17:16.357 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename bar bar2 2024-09-16T11:17:16.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename bar2 foo2 2024-09-16T11:17:16.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep exists 2024-09-16T11:17:16.505 INFO:tasks.workunit.client.0.smithi137.stdout:2024-09-16T11:17:16.490+0000 7fe31edd04c0 -1 librbd::Operations: rbd image foo2 already exists 2024-09-16T11:17:16.505 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: rename error: (17) File exists 2024-09-16T11:17:16.506 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool create rbd2 8 2024-09-16T11:17:17.451 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' already exists 2024-09-16T11:17:17.459 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd pool init rbd2 2024-09-16T11:17:20.379 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -p rbd2 -s 1 foo 2024-09-16T11:17:20.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:20.410+0000 7fabecf344c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:22.409 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename rbd2/foo rbd2/bar 2024-09-16T11:17:22.641 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:22.634+0000 7f0483cd1700 0 --2- 172.21.15.137:0/2473589158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56486b3ed120 0x56486b490790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T11:17:22.683 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls 2024-09-16T11:17:22.683 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep bar 2024-09-16T11:17:22.728 INFO:tasks.workunit.client.0.smithi137.stdout:bar 2024-09-16T11:17:22.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename rbd2/bar foo 2024-09-16T11:17:22.803 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename --pool rbd2 foo bar 2024-09-16T11:17:22.874 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2024-09-16T11:17:22.903 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: mv/rename across pools not supported 2024-09-16T11:17:22.904 INFO:tasks.workunit.client.0.smithi137.stderr:source pool: rbd2 dest pool: rbd 2024-09-16T11:17:22.905 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2024-09-16T11:17:22.981 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls 2024-09-16T11:17:22.981 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep foo 2024-09-16T11:17:23.027 INFO:tasks.workunit.client.0.smithi137.stdout:foo 2024-09-16T11:17:23.027 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-16T11:17:23.502 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' does not exist 2024-09-16T11:17:23.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:17:23.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:23.620 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:23.740 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:23.853 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:23.968 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.082 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.200 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.641 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:24.876 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.005 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.123 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.352 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.461 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.692 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.803 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:25.922 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_ls 2024-09-16T11:17:25.923 INFO:tasks.workunit.client.0.smithi137.stdout:testing ls... 2024-09-16T11:17:25.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing ls...' 2024-09-16T11:17:25.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:17:25.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.039 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.277 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.392 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.627 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.743 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.859 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:26.966 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.084 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.321 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.440 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.545 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.659 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.779 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:27.897 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:28.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-16T11:17:28.040 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:17:28.056 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:28.046+0000 7f25eaf434c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:28.066 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 test2 2024-09-16T11:17:28.093 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:17:28.104 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:28.098+0000 7f8d9c9d34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:28.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:17:28.159 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:17:28.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:17:28.201 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:17:28.201 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:28.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:17:28.243 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:17:28.244 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:28.244 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*1 MiB.*1' 2024-09-16T11:17:28.297 INFO:tasks.workunit.client.0.smithi137.stdout:test1 1 MiB 1 2024-09-16T11:17:28.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:28.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*1 MiB.*1' 2024-09-16T11:17:28.350 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 1 2024-09-16T11:17:28.351 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:17:28.408 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:28.412 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:17:28.471 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:28.476 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:17:28.540 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-16T11:17:28.607 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.607 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:17:28.645 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:17:28.645 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.645 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:17:28.685 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:17:28.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:28.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:28.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:17:28.729 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:17:28.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*1 MiB.*2' 2024-09-16T11:17:28.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:28.789 INFO:tasks.workunit.client.0.smithi137.stdout:test1 1 MiB 2 2024-09-16T11:17:28.789 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:28.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*1 MiB.*2' 2024-09-16T11:17:28.847 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 2 2024-09-16T11:17:28.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:17:29.016 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:29.010+0000 7f5f4b45c700 0 -- 172.21.15.137:0/579627514 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f5f240066d0 msgr2=0x7f5f240127e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:29.016 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:29.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:17:29.178 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:29.174+0000 7f3f1b88d700 0 -- 172.21.15.137:0/3112972629 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x559c1a861850 msgr2=0x559c1a902280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:29.181 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:29.186 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:17:29.257 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 test2 2024-09-16T11:17:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:17:29.297 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:29.290+0000 7fdd54f9a4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:29.308 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:29.309 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:17:29.350 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:17:29.350 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:29.350 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:17:29.395 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:17:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:29.396 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:17:29.440 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:17:29.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:29.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*1 MiB.*2' 2024-09-16T11:17:29.500 INFO:tasks.workunit.client.0.smithi137.stdout:test1 1 MiB 2 2024-09-16T11:17:29.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:29.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*1 MiB.*1' 2024-09-16T11:17:29.561 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 1 2024-09-16T11:17:29.562 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:17:29.562 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:29.884 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.002 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.126 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.247 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.367 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.483 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.712 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:30.942 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.058 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.177 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.519 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.637 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:31.753 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:32.075 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:17:32.185 INFO:tasks.workunit.client.0.smithi137.stderr:++ seq -w 00 99 2024-09-16T11:17:32.279 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.279 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.00 -s 1 2024-09-16T11:17:32.323 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.318+0000 7f7ca0bb94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.334 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.335 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.01 -s 1 2024-09-16T11:17:32.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.366+0000 7fb53a9b34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.381 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.381 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.02 -s 1 2024-09-16T11:17:32.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.414+0000 7f343f7744c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.429 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.429 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.03 -s 1 2024-09-16T11:17:32.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.466+0000 7f05e8ac84c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.04 -s 1 2024-09-16T11:17:32.521 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.514+0000 7f0d576404c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.531 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.532 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.05 -s 1 2024-09-16T11:17:32.573 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.566+0000 7fc4fc8904c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.583 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.583 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.06 -s 1 2024-09-16T11:17:32.622 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.618+0000 7f3ff32cf4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.638 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.638 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.07 -s 1 2024-09-16T11:17:32.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.674+0000 7f18e6fef4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.694 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.694 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.08 -s 1 2024-09-16T11:17:32.733 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.726+0000 7fad3e97f4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.744 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.744 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.09 -s 1 2024-09-16T11:17:32.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.778+0000 7f67fce834c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.793 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.793 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.10 -s 1 2024-09-16T11:17:32.834 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.830+0000 7feb200ce4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.845 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.845 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.11 -s 1 2024-09-16T11:17:32.883 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.878+0000 7f375ade44c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.896 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.896 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.12 -s 1 2024-09-16T11:17:32.937 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.930+0000 7fa7399e24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:32.954 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:32.997 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.13 -s 1 2024-09-16T11:17:32.997 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:32.990+0000 7f1ca20fb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.009 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.009 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.14 -s 1 2024-09-16T11:17:33.046 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.042+0000 7f146e7c84c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.063 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.063 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.15 -s 1 2024-09-16T11:17:33.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.098+0000 7f78817d74c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.16 -s 1 2024-09-16T11:17:33.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.154+0000 7f089c5e34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.17 -s 1 2024-09-16T11:17:33.211 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.206+0000 7f1089a2d4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.18 -s 1 2024-09-16T11:17:33.261 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.254+0000 7fa8f9b0b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.276 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.276 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.19 -s 1 2024-09-16T11:17:33.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.310+0000 7fc76258a4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.326 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.327 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.20 -s 1 2024-09-16T11:17:33.365 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.358+0000 7fe33c95f4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.21 -s 1 2024-09-16T11:17:33.418 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.414+0000 7f0cce1154c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.430 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.431 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.22 -s 1 2024-09-16T11:17:33.473 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.466+0000 7fcbe3de94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.487 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.487 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.23 -s 1 2024-09-16T11:17:33.527 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.522+0000 7f7f4607b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.539 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.539 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.24 -s 1 2024-09-16T11:17:33.579 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.574+0000 7fbd8c4c24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.591 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.591 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.25 -s 1 2024-09-16T11:17:33.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.626+0000 7fa49e1ef4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.641 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.641 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.26 -s 1 2024-09-16T11:17:33.679 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.674+0000 7f024c8184c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.691 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.691 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.27 -s 1 2024-09-16T11:17:33.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.726+0000 7f4327e6b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.742 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.742 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.28 -s 1 2024-09-16T11:17:33.782 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.778+0000 7f239ce034c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.792 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.792 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.29 -s 1 2024-09-16T11:17:33.835 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.830+0000 7ff4c04644c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.847 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.847 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.30 -s 1 2024-09-16T11:17:33.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.882+0000 7f1359a704c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.898 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.898 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.31 -s 1 2024-09-16T11:17:33.939 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.934+0000 7f4f705354c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.950 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.950 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.32 -s 1 2024-09-16T11:17:33.993 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:33.982+0000 7fbdfb4c94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:33.999 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:33.999 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.33 -s 1 2024-09-16T11:17:34.038 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.034+0000 7f95a352d4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.049 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.049 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.34 -s 1 2024-09-16T11:17:34.090 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.086+0000 7f16962254c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.35 -s 1 2024-09-16T11:17:34.143 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.138+0000 7fab0013d4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.151 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.151 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.36 -s 1 2024-09-16T11:17:34.190 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.186+0000 7f51675f24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.200 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.200 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.37 -s 1 2024-09-16T11:17:34.240 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.234+0000 7fdb501994c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.254 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.254 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.38 -s 1 2024-09-16T11:17:34.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.286+0000 7fdebfdb14c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.39 -s 1 2024-09-16T11:17:34.346 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.338+0000 7f07d0f264c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.358 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.359 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.40 -s 1 2024-09-16T11:17:34.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.394+0000 7ff7229fb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.411 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.412 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.41 -s 1 2024-09-16T11:17:34.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.446+0000 7f2bbdc224c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.463 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.42 -s 1 2024-09-16T11:17:34.504 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.498+0000 7f90216b54c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.516 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.516 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.43 -s 1 2024-09-16T11:17:34.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.554+0000 7fb93a6344c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.569 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.570 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.44 -s 1 2024-09-16T11:17:34.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.606+0000 7fb8688ca4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.621 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.621 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.45 -s 1 2024-09-16T11:17:34.661 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.654+0000 7f16052404c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.673 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.673 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.46 -s 1 2024-09-16T11:17:34.711 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.706+0000 7f23ed99b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.722 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.722 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.47 -s 1 2024-09-16T11:17:34.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.754+0000 7fe61968b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.772 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.772 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.48 -s 1 2024-09-16T11:17:34.809 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.802+0000 7fefe6bd94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.818 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.818 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.49 -s 1 2024-09-16T11:17:34.854 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.846+0000 7f0c3f51c4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.865 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.865 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.50 -s 1 2024-09-16T11:17:34.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.898+0000 7f7a0a4eb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.51 -s 1 2024-09-16T11:17:34.958 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:34.954+0000 7f11dd0b24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:34.968 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:34.968 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.52 -s 1 2024-09-16T11:17:35.006 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.002+0000 7fa72a2de4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.53 -s 1 2024-09-16T11:17:35.058 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.054+0000 7efd628fc4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.068 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.068 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.54 -s 1 2024-09-16T11:17:35.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.102+0000 7f90297964c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.119 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.119 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.55 -s 1 2024-09-16T11:17:35.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.154+0000 7fdbbbac54c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.170 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.170 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.56 -s 1 2024-09-16T11:17:35.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.202+0000 7fd13c0244c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.224 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.57 -s 1 2024-09-16T11:17:35.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.258+0000 7f1436ffa4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.279 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.279 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.58 -s 1 2024-09-16T11:17:35.321 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.314+0000 7f6ba178b4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.59 -s 1 2024-09-16T11:17:35.372 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.366+0000 7ff1735614c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.384 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.384 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.60 -s 1 2024-09-16T11:17:35.424 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.418+0000 7fc7765f64c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.444 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.444 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.61 -s 1 2024-09-16T11:17:35.489 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.482+0000 7f20d31f34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.62 -s 1 2024-09-16T11:17:35.541 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.534+0000 7fabffb754c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.552 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.552 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.63 -s 1 2024-09-16T11:17:35.591 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.586+0000 7f04812a34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.602 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.602 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.64 -s 1 2024-09-16T11:17:35.645 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.638+0000 7ff7dca834c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.659 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.659 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.65 -s 1 2024-09-16T11:17:35.694 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.690+0000 7f7ccbaf94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.706 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.706 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.66 -s 1 2024-09-16T11:17:35.748 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.742+0000 7f38949744c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.67 -s 1 2024-09-16T11:17:35.799 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.794+0000 7fd72f4b84c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.813 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.813 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.68 -s 1 2024-09-16T11:17:35.852 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.846+0000 7f8a9a2554c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.864 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.864 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.69 -s 1 2024-09-16T11:17:35.905 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.898+0000 7f1811edb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.917 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.917 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.70 -s 1 2024-09-16T11:17:35.959 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:35.954+0000 7f9b568574c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:35.972 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:35.972 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.71 -s 1 2024-09-16T11:17:36.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.006+0000 7f52338c24c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.022 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.022 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.72 -s 1 2024-09-16T11:17:36.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.054+0000 7fc93cbcb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.074 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.074 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.73 -s 1 2024-09-16T11:17:36.109 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.102+0000 7f9ff49f84c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.119 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.119 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.74 -s 1 2024-09-16T11:17:36.161 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.154+0000 7f2d3b1924c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.75 -s 1 2024-09-16T11:17:36.212 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.206+0000 7fbe00fa14c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.224 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.76 -s 1 2024-09-16T11:17:36.264 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.258+0000 7f95e59084c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.276 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.276 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.77 -s 1 2024-09-16T11:17:36.314 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.310+0000 7fbd9ebda4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.326 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.326 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.78 -s 1 2024-09-16T11:17:36.368 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.362+0000 7f1f630ab4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.380 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.380 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.79 -s 1 2024-09-16T11:17:36.419 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.414+0000 7f8fe5a4e4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.432 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.432 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.80 -s 1 2024-09-16T11:17:36.471 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.466+0000 7fdba58294c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.81 -s 1 2024-09-16T11:17:36.523 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.518+0000 7f642d9f34c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.536 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.536 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.82 -s 1 2024-09-16T11:17:36.575 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.570+0000 7f69f8b014c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.83 -s 1 2024-09-16T11:17:36.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.626+0000 7fd98095e4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.644 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.84 -s 1 2024-09-16T11:17:36.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.678+0000 7f87f3b064c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.697 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.697 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.85 -s 1 2024-09-16T11:17:36.737 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.730+0000 7f08e634a4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.86 -s 1 2024-09-16T11:17:36.789 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.782+0000 7f42c3c054c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.803 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.803 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.87 -s 1 2024-09-16T11:17:36.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.834+0000 7fe8c02764c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.850 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.850 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.88 -s 1 2024-09-16T11:17:36.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.882+0000 7f73c20344c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.900 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.900 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.89 -s 1 2024-09-16T11:17:36.941 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.934+0000 7fb87c53f4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:36.962 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:36.962 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.90 -s 1 2024-09-16T11:17:37.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:36.998+0000 7ff003dfe4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.015 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.015 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.91 -s 1 2024-09-16T11:17:37.054 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.050+0000 7f1662ef14c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.064 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.064 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.92 -s 1 2024-09-16T11:17:37.101 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.094+0000 7fa7efec74c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.114 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.93 -s 1 2024-09-16T11:17:37.350 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.346+0000 7fb9d95ec700 0 --2- 172.21.15.137:0/4152041995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56435da806f0 0x56435d9e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T11:17:37.360 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.354+0000 7fb9db2b74c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.376 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.376 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.94 -s 1 2024-09-16T11:17:37.413 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.406+0000 7f3df61b64c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.423 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.423 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.95 -s 1 2024-09-16T11:17:37.457 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.450+0000 7faca012a4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.96 -s 1 2024-09-16T11:17:37.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.502+0000 7f3bec32e4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.522 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.522 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.97 -s 1 2024-09-16T11:17:37.560 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.554+0000 7f3e6748c4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.571 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.571 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.98 -s 1 2024-09-16T11:17:37.611 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.606+0000 7f02fb6d94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.620 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:37.620 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.99 -s 1 2024-09-16T11:17:37.659 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.654+0000 7f373982c4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:17:37.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:37.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:37.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 100 2024-09-16T11:17:37.712 INFO:tasks.workunit.client.0.smithi137.stdout:100 2024-09-16T11:17:37.712 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:37.713 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep image 2024-09-16T11:17:37.713 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:37.713 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 100 2024-09-16T11:17:37.804 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.798+0000 7f9506f58700 0 -- 172.21.15.137:0/2559530017 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5593745355a0 msgr2=0x55937453b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:37.817 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:37.810+0000 7f9507759700 0 -- 172.21.15.137:0/2559530017 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55937452f690 msgr2=0x559374489ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:17:38.036 INFO:tasks.workunit.client.0.smithi137.stdout:100 2024-09-16T11:17:38.037 INFO:tasks.workunit.client.0.smithi137.stderr:++ seq -w 00 99 2024-09-16T11:17:38.037 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.037 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.00 2024-09-16T11:17:38.096 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.100 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.100 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.01 2024-09-16T11:17:38.162 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.167 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.167 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.02 2024-09-16T11:17:38.233 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.03 2024-09-16T11:17:38.306 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.311 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.311 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.04 2024-09-16T11:17:38.380 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.385 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.385 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.05 2024-09-16T11:17:38.445 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.453 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.453 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.06 2024-09-16T11:17:38.520 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.07 2024-09-16T11:17:38.589 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.08 2024-09-16T11:17:38.656 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.09 2024-09-16T11:17:38.730 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.733 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.733 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.10 2024-09-16T11:17:38.791 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.11 2024-09-16T11:17:38.861 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.866 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.866 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.12 2024-09-16T11:17:38.926 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.931 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.931 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.13 2024-09-16T11:17:38.990 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:38.995 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:38.995 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.14 2024-09-16T11:17:39.057 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.063 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.063 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.15 2024-09-16T11:17:39.125 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.130 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.130 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.16 2024-09-16T11:17:39.192 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.196 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.197 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.17 2024-09-16T11:17:39.260 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.266 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.18 2024-09-16T11:17:39.328 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.19 2024-09-16T11:17:39.562 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:39.558+0000 7fc4a0699700 0 --2- 172.21.15.137:0/3474399960 >> v2:172.21.15.137:3300/0 conn(0x55deb4e632c0 0x55deb4f01690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T11:17:39.604 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.609 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.609 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.20 2024-09-16T11:17:39.668 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.21 2024-09-16T11:17:39.733 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.737 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.737 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.22 2024-09-16T11:17:39.799 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.23 2024-09-16T11:17:39.865 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.869 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.869 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.24 2024-09-16T11:17:39.927 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.931 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.931 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.25 2024-09-16T11:17:39.990 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:39.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.26 2024-09-16T11:17:40.058 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.062 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.063 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.27 2024-09-16T11:17:40.125 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.129 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.129 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.28 2024-09-16T11:17:40.191 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.195 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.196 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.29 2024-09-16T11:17:40.260 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.265 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.30 2024-09-16T11:17:40.324 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.329 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.329 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.31 2024-09-16T11:17:40.390 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.32 2024-09-16T11:17:40.457 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.461 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.33 2024-09-16T11:17:40.520 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.34 2024-09-16T11:17:40.590 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.35 2024-09-16T11:17:40.664 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.668 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.668 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.36 2024-09-16T11:17:40.739 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.744 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.744 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.37 2024-09-16T11:17:40.814 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.819 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.819 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.38 2024-09-16T11:17:40.887 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.39 2024-09-16T11:17:40.959 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:40.964 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:40.964 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.40 2024-09-16T11:17:41.031 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.41 2024-09-16T11:17:41.099 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.42 2024-09-16T11:17:41.160 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.163 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.164 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.43 2024-09-16T11:17:41.228 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.231 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.231 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.44 2024-09-16T11:17:41.291 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.296 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.296 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.45 2024-09-16T11:17:41.365 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.370 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.370 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.46 2024-09-16T11:17:41.437 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.442 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.442 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.47 2024-09-16T11:17:41.509 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.48 2024-09-16T11:17:41.587 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.592 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.592 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.49 2024-09-16T11:17:41.654 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.50 2024-09-16T11:17:41.726 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.51 2024-09-16T11:17:41.793 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.52 2024-09-16T11:17:41.862 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.867 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.867 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.53 2024-09-16T11:17:41.932 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:41.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:41.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.54 2024-09-16T11:17:42.003 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.009 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.009 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.55 2024-09-16T11:17:42.069 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.074 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.074 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.56 2024-09-16T11:17:42.137 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.57 2024-09-16T11:17:42.199 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.58 2024-09-16T11:17:42.266 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.271 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.271 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.59 2024-09-16T11:17:42.332 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.336 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.336 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.60 2024-09-16T11:17:42.391 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.395 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.395 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.61 2024-09-16T11:17:42.456 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.459 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.460 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.62 2024-09-16T11:17:42.523 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.63 2024-09-16T11:17:42.599 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.64 2024-09-16T11:17:42.664 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.668 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.668 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.65 2024-09-16T11:17:42.735 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.66 2024-09-16T11:17:42.803 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.67 2024-09-16T11:17:42.867 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.872 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.872 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.68 2024-09-16T11:17:42.941 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:42.945 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:42.946 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.69 2024-09-16T11:17:43.005 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.012 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.012 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.70 2024-09-16T11:17:43.075 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.078 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.079 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.71 2024-09-16T11:17:43.135 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.139 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.139 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.72 2024-09-16T11:17:43.205 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.209 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.209 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.73 2024-09-16T11:17:43.476 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.74 2024-09-16T11:17:43.545 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.75 2024-09-16T11:17:43.611 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.615 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.76 2024-09-16T11:17:43.690 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.695 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.695 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.77 2024-09-16T11:17:43.759 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.763 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.763 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.78 2024-09-16T11:17:43.828 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.833 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.79 2024-09-16T11:17:43.901 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.906 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.906 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.80 2024-09-16T11:17:43.975 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:43.980 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:43.980 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.81 2024-09-16T11:17:44.049 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.82 2024-09-16T11:17:44.118 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.123 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.123 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.83 2024-09-16T11:17:44.184 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.188 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.188 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.84 2024-09-16T11:17:44.252 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.255 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.255 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.85 2024-09-16T11:17:44.312 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.86 2024-09-16T11:17:44.373 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.87 2024-09-16T11:17:44.436 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.88 2024-09-16T11:17:44.506 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.89 2024-09-16T11:17:44.574 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.579 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.579 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.90 2024-09-16T11:17:44.652 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.656 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.656 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.91 2024-09-16T11:17:44.718 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.722 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.723 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.92 2024-09-16T11:17:44.791 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.93 2024-09-16T11:17:44.856 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.861 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.861 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.94 2024-09-16T11:17:44.922 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:44.926 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:44.926 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.95 2024-09-16T11:17:45.002 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:45.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.96 2024-09-16T11:17:45.285 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:45.289 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.290 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.97 2024-09-16T11:17:45.348 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:45.353 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.353 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.98 2024-09-16T11:17:45.421 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:45.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.99 2024-09-16T11:17:45.488 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:45.493 INFO:tasks.workunit.client.0.smithi137.stderr:++ seq -w 00 99 2024-09-16T11:17:45.494 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.494 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.00 --image-format 2 -s 1 2024-09-16T11:17:45.564 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.565 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.01 --image-format 2 -s 1 2024-09-16T11:17:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.622 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.02 --image-format 2 -s 1 2024-09-16T11:17:45.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.03 --image-format 2 -s 1 2024-09-16T11:17:45.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.04 --image-format 2 -s 1 2024-09-16T11:17:45.810 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.811 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.05 --image-format 2 -s 1 2024-09-16T11:17:45.880 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.880 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.06 --image-format 2 -s 1 2024-09-16T11:17:45.944 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:45.944 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.07 --image-format 2 -s 1 2024-09-16T11:17:46.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.08 --image-format 2 -s 1 2024-09-16T11:17:46.079 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.079 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.09 --image-format 2 -s 1 2024-09-16T11:17:46.143 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.143 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.10 --image-format 2 -s 1 2024-09-16T11:17:46.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.11 --image-format 2 -s 1 2024-09-16T11:17:46.268 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.269 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.12 --image-format 2 -s 1 2024-09-16T11:17:46.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.13 --image-format 2 -s 1 2024-09-16T11:17:46.401 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.402 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.14 --image-format 2 -s 1 2024-09-16T11:17:46.463 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.463 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.15 --image-format 2 -s 1 2024-09-16T11:17:46.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.16 --image-format 2 -s 1 2024-09-16T11:17:46.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.17 --image-format 2 -s 1 2024-09-16T11:17:46.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.18 --image-format 2 -s 1 2024-09-16T11:17:46.930 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.930 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.19 --image-format 2 -s 1 2024-09-16T11:17:46.995 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:46.995 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.20 --image-format 2 -s 1 2024-09-16T11:17:47.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.21 --image-format 2 -s 1 2024-09-16T11:17:47.116 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.116 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.22 --image-format 2 -s 1 2024-09-16T11:17:47.174 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.23 --image-format 2 -s 1 2024-09-16T11:17:47.239 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.239 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.24 --image-format 2 -s 1 2024-09-16T11:17:47.302 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.303 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.25 --image-format 2 -s 1 2024-09-16T11:17:47.370 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.370 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.26 --image-format 2 -s 1 2024-09-16T11:17:47.438 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.439 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.27 --image-format 2 -s 1 2024-09-16T11:17:47.708 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.709 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.28 --image-format 2 -s 1 2024-09-16T11:17:47.775 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.775 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.29 --image-format 2 -s 1 2024-09-16T11:17:47.836 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.836 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.30 --image-format 2 -s 1 2024-09-16T11:17:47.898 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.898 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.31 --image-format 2 -s 1 2024-09-16T11:17:47.964 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:47.965 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.32 --image-format 2 -s 1 2024-09-16T11:17:48.022 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.023 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.33 --image-format 2 -s 1 2024-09-16T11:17:48.083 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.083 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.34 --image-format 2 -s 1 2024-09-16T11:17:48.145 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.145 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.35 --image-format 2 -s 1 2024-09-16T11:17:48.206 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.206 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.36 --image-format 2 -s 1 2024-09-16T11:17:48.268 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.269 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.37 --image-format 2 -s 1 2024-09-16T11:17:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.330 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.38 --image-format 2 -s 1 2024-09-16T11:17:48.391 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.392 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.39 --image-format 2 -s 1 2024-09-16T11:17:48.458 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.458 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.40 --image-format 2 -s 1 2024-09-16T11:17:48.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.521 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.41 --image-format 2 -s 1 2024-09-16T11:17:48.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.42 --image-format 2 -s 1 2024-09-16T11:17:48.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.43 --image-format 2 -s 1 2024-09-16T11:17:48.723 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.723 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.44 --image-format 2 -s 1 2024-09-16T11:17:48.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.785 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.45 --image-format 2 -s 1 2024-09-16T11:17:48.852 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.852 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.46 --image-format 2 -s 1 2024-09-16T11:17:48.917 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.918 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.47 --image-format 2 -s 1 2024-09-16T11:17:48.980 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:48.980 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.48 --image-format 2 -s 1 2024-09-16T11:17:49.043 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.043 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.49 --image-format 2 -s 1 2024-09-16T11:17:49.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.50 --image-format 2 -s 1 2024-09-16T11:17:49.166 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.167 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.51 --image-format 2 -s 1 2024-09-16T11:17:49.234 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.234 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.52 --image-format 2 -s 1 2024-09-16T11:17:49.293 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.294 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.53 --image-format 2 -s 1 2024-09-16T11:17:49.352 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.352 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.54 --image-format 2 -s 1 2024-09-16T11:17:49.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.55 --image-format 2 -s 1 2024-09-16T11:17:49.494 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.494 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.56 --image-format 2 -s 1 2024-09-16T11:17:49.559 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.559 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.57 --image-format 2 -s 1 2024-09-16T11:17:49.628 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.628 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.58 --image-format 2 -s 1 2024-09-16T11:17:49.696 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.696 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.59 --image-format 2 -s 1 2024-09-16T11:17:49.759 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.60 --image-format 2 -s 1 2024-09-16T11:17:49.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.61 --image-format 2 -s 1 2024-09-16T11:17:49.878 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.879 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.62 --image-format 2 -s 1 2024-09-16T11:17:49.938 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:49.938 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.63 --image-format 2 -s 1 2024-09-16T11:17:50.005 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.005 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.64 --image-format 2 -s 1 2024-09-16T11:17:50.073 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.073 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.65 --image-format 2 -s 1 2024-09-16T11:17:50.139 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.139 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.66 --image-format 2 -s 1 2024-09-16T11:17:50.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.67 --image-format 2 -s 1 2024-09-16T11:17:50.273 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.273 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.68 --image-format 2 -s 1 2024-09-16T11:17:50.335 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.335 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.69 --image-format 2 -s 1 2024-09-16T11:17:50.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.70 --image-format 2 -s 1 2024-09-16T11:17:50.460 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.461 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.71 --image-format 2 -s 1 2024-09-16T11:17:50.522 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.522 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.72 --image-format 2 -s 1 2024-09-16T11:17:50.583 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.583 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.73 --image-format 2 -s 1 2024-09-16T11:17:50.646 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.647 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.74 --image-format 2 -s 1 2024-09-16T11:17:50.718 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.718 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.75 --image-format 2 -s 1 2024-09-16T11:17:50.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.76 --image-format 2 -s 1 2024-09-16T11:17:50.851 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.851 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.77 --image-format 2 -s 1 2024-09-16T11:17:50.924 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.924 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.78 --image-format 2 -s 1 2024-09-16T11:17:50.992 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:50.992 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.79 --image-format 2 -s 1 2024-09-16T11:17:51.058 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.058 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.80 --image-format 2 -s 1 2024-09-16T11:17:51.124 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.124 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.81 --image-format 2 -s 1 2024-09-16T11:17:51.184 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.82 --image-format 2 -s 1 2024-09-16T11:17:51.245 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.245 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.83 --image-format 2 -s 1 2024-09-16T11:17:51.312 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.312 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.84 --image-format 2 -s 1 2024-09-16T11:17:51.374 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.375 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.85 --image-format 2 -s 1 2024-09-16T11:17:51.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.86 --image-format 2 -s 1 2024-09-16T11:17:51.512 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.513 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.87 --image-format 2 -s 1 2024-09-16T11:17:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.578 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.88 --image-format 2 -s 1 2024-09-16T11:17:51.635 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.635 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.89 --image-format 2 -s 1 2024-09-16T11:17:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.697 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.90 --image-format 2 -s 1 2024-09-16T11:17:51.767 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.767 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.91 --image-format 2 -s 1 2024-09-16T11:17:51.829 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.829 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.92 --image-format 2 -s 1 2024-09-16T11:17:51.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.93 --image-format 2 -s 1 2024-09-16T11:17:51.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:51.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.94 --image-format 2 -s 1 2024-09-16T11:17:52.027 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.027 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.95 --image-format 2 -s 1 2024-09-16T11:17:52.090 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.146 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.96 --image-format 2 -s 1 2024-09-16T11:17:52.161 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.161 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.97 --image-format 2 -s 1 2024-09-16T11:17:52.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.98 --image-format 2 -s 1 2024-09-16T11:17:52.298 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.298 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create image.99 --image-format 2 -s 1 2024-09-16T11:17:52.368 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:17:52.369 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:52.369 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 100 2024-09-16T11:17:52.413 INFO:tasks.workunit.client.0.smithi137.stdout:100 2024-09-16T11:17:52.413 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:17:52.413 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep image 2024-09-16T11:17:52.414 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:17:52.414 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 100 2024-09-16T11:17:52.495 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:52.490+0000 7f358d62a700 0 -- 172.21.15.137:0/3795440535 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55fcb0ed1780 msgr2=0x55fcb0eda400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:52.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:52.494+0000 7f358d62a700 0 -- 172.21.15.137:0/3795440535 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f357003a620 msgr2=0x7f357003ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:52.840 INFO:tasks.workunit.client.0.smithi137.stdout:100 2024-09-16T11:17:52.841 INFO:tasks.workunit.client.0.smithi137.stderr:++ seq -w 00 99 2024-09-16T11:17:52.841 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:52.841 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.00 2024-09-16T11:17:53.009 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.002+0000 7f60b4700700 0 -- 172.21.15.137:0/3832231843 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f6098008980 msgr2=0x7f609800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.009 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.01 2024-09-16T11:17:53.205 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.198+0000 7fcbfc544700 0 -- 172.21.15.137:0/2878755490 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fcbe0008980 msgr2=0x7fcbe000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.205 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.210 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.210 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.02 2024-09-16T11:17:53.389 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.382+0000 7fc1c3d58700 0 -- 172.21.15.137:0/74341362 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fc19c005fa0 msgr2=0x7fc19c008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.391 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.395 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.395 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.03 2024-09-16T11:17:53.593 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.586+0000 7f4c9743b700 0 -- 172.21.15.137:0/3774214870 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f4c7c008980 msgr2=0x7f4c7c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.595 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.600 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.600 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.04 2024-09-16T11:17:53.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.770+0000 7f82e7a5c700 0 -- 172.21.15.137:0/10633670 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f82cc008980 msgr2=0x7f82cc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.777 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.781 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.781 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.05 2024-09-16T11:17:53.947 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:53.942+0000 7f0f58542700 0 -- 172.21.15.137:0/1864503237 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0f3c03a620 msgr2=0x7f0f3c03ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:53.965 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:53.969 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:53.969 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.06 2024-09-16T11:17:54.159 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:54.154+0000 7f950de51700 0 -- 172.21.15.137:0/3514154476 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f94f4008980 msgr2=0x7f94f400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:54.159 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:54.165 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:54.165 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.07 2024-09-16T11:17:54.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:54.322+0000 7fb0847bf700 0 -- 172.21.15.137:0/337587508 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556300dd5280 msgr2=0x556300decb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:54.330 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:54.335 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:54.335 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.08 2024-09-16T11:17:54.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:54.514+0000 7fe6891ab700 0 -- 172.21.15.137:0/882454123 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fe664008980 msgr2=0x7fe66400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:54.520 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:54.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:54.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.09 2024-09-16T11:17:54.690 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:54.686+0000 7efdf7b34700 0 -- 172.21.15.137:0/1682057152 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7efdd4008980 msgr2=0x7efdd400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:54.692 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:54.696 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:54.696 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.10 2024-09-16T11:17:54.884 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:54.878+0000 7f314bb58700 0 -- 172.21.15.137:0/1535515459 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3128008af0 msgr2=0x7f312800af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:54.884 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:54.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:54.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.11 2024-09-16T11:17:55.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:55.074+0000 7f03fba9e700 0 -- 172.21.15.137:0/2528669425 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f03e0008980 msgr2=0x7f03e000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:55.082 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:55.088 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:55.088 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.12 2024-09-16T11:17:55.265 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:55.258+0000 7f78eed7e700 0 -- 172.21.15.137:0/2467978384 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f78c8006750 msgr2=0x7f78c8008bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:55.266 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:55.272 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:55.272 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.13 2024-09-16T11:17:55.446 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:55.442+0000 7fd544862700 0 -- 172.21.15.137:0/1466320568 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fd528008980 msgr2=0x7fd52800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:55.447 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:55.451 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:55.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.14 2024-09-16T11:17:55.639 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:55.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:55.644 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.15 2024-09-16T11:17:55.838 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:55.834+0000 7fac74bec700 0 -- 172.21.15.137:0/2190095971 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55f2fc633160 msgr2=0x55f2fc60eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:55.838 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:55.843 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:55.843 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.16 2024-09-16T11:17:56.012 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.006+0000 7fbc2ba21700 0 -- 172.21.15.137:0/3518740650 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fbc10006750 msgr2=0x7fbc10012870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:56.014 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.019 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.019 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.17 2024-09-16T11:17:56.198 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.194+0000 7fd897a9b700 0 -- 172.21.15.137:0/1443011115 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x562db6d78850 msgr2=0x562db6e19130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:56.208 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.213 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.213 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.18 2024-09-16T11:17:56.377 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.370+0000 7fda6afc6700 0 -- 172.21.15.137:0/2430405011 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fda4c03a610 msgr2=0x7fda4c03c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:56.386 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.391 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.391 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.19 2024-09-16T11:17:56.565 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.562+0000 7f3e4b057700 0 -- 172.21.15.137:0/1803478081 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3e30008980 msgr2=0x7f3e3000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:56.567 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.20 2024-09-16T11:17:56.760 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.754+0000 7f3c1f70d700 0 -- 172.21.15.137:0/3243747640 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3bfc008980 msgr2=0x7f3bfc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:56.760 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.764 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.764 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.21 2024-09-16T11:17:56.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:56.942+0000 7fe0fd141700 0 -- 172.21.15.137:0/1816403919 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55b3cbd5c190 msgr2=0x55b3cbd349a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:17:56.947 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:56.951 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:56.951 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.22 2024-09-16T11:17:57.130 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:57.126+0000 7f4c3b898700 0 -- 172.21.15.137:0/294008911 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f4c20008980 msgr2=0x7f4c2000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:57.131 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:57.134 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:57.135 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.23 2024-09-16T11:17:57.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:57.298+0000 7f75be917700 0 -- 172.21.15.137:0/443686680 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f75a4008980 msgr2=0x7f75a400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:57.305 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:57.310 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:57.310 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.24 2024-09-16T11:17:57.491 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:57.486+0000 7f2984758700 0 -- 172.21.15.137:0/2884632867 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f2968008980 msgr2=0x7f296800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:57.491 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:57.496 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:57.496 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.25 2024-09-16T11:17:57.670 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:57.666+0000 7f2b0d06f700 0 -- 172.21.15.137:0/3424101475 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x564adfeebf10 msgr2=0x564adff8e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:57.673 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:57.679 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:57.679 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.26 2024-09-16T11:17:57.865 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:57.862+0000 7fce8dabe700 0 -- 172.21.15.137:0/3524442777 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x561eeda0c710 msgr2=0x561eeda56340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:57.868 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:57.872 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:57.872 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.27 2024-09-16T11:17:58.041 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.034+0000 7fd3f83e1700 0 -- 172.21.15.137:0/3047507357 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5636af65a640 msgr2=0x5636af60d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.041 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.28 2024-09-16T11:17:58.222 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.218+0000 7fc2a268d700 0 -- 172.21.15.137:0/1060575982 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fc288008980 msgr2=0x7fc28800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.224 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.229 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.229 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.29 2024-09-16T11:17:58.402 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.398+0000 7f25abb3b700 0 -- 172.21.15.137:0/3444524697 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f2590008af0 msgr2=0x7f259000af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.402 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.30 2024-09-16T11:17:58.581 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.574+0000 7efceeeaa700 0 -- 172.21.15.137:0/424913500 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7efccc015740 msgr2=0x7efccc010550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.582 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.31 2024-09-16T11:17:58.745 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.738+0000 7f436f5a0700 0 -- 172.21.15.137:0/194637817 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f434c008980 msgr2=0x7f434c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.745 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.32 2024-09-16T11:17:58.924 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:58.918+0000 7fd0e228d700 0 -- 172.21.15.137:0/3897368586 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x564c37078500 msgr2=0x564c3707c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:58.924 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:58.929 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:58.929 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.33 2024-09-16T11:17:59.113 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:59.106+0000 7f1c97a45700 0 -- 172.21.15.137:0/3835016875 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556e7890a650 msgr2=0x556e78921b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:59.115 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:59.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:59.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.34 2024-09-16T11:17:59.294 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:59.290+0000 7f80ac0e8700 0 -- 172.21.15.137:0/150211779 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f8090008980 msgr2=0x7f809000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:59.294 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:59.299 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:59.299 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.35 2024-09-16T11:17:59.499 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:59.494+0000 7f0b60539700 0 -- 172.21.15.137:0/3308781714 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0b44008980 msgr2=0x7f0b4400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:59.499 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:59.503 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:59.503 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.36 2024-09-16T11:17:59.683 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:59.678+0000 7fd9dcf5e700 0 -- 172.21.15.137:0/3553082432 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fd9b8008980 msgr2=0x7fd9b800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:17:59.691 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:59.695 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:59.695 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.37 2024-09-16T11:17:59.878 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:17:59.874+0000 7fa3ab7c1700 0 -- 172.21.15.137:0/2935866335 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fa390008af0 msgr2=0x7fa39000af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:17:59.878 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:17:59.884 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:17:59.884 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.38 2024-09-16T11:18:00.066 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:00.062+0000 7ff0774cf700 0 -- 172.21.15.137:0/3262666327 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff05803a620 msgr2=0x7ff05803ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:00.272 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:00.277 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:00.278 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.39 2024-09-16T11:18:00.451 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:00.446+0000 7f76604fc700 0 -- 172.21.15.137:0/4276775922 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x563163ff5f30 msgr2=0x56316409e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:00.458 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:00.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:00.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.40 2024-09-16T11:18:00.629 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:00.622+0000 7fbfc1648700 0 -- 172.21.15.137:0/3202400114 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7fbfa403a620 msgr2=0x7fbfa403ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:00.643 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:00.648 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:00.648 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.41 2024-09-16T11:18:00.814 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:00.810+0000 7fe40eb21700 0 -- 172.21.15.137:0/445171414 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x555d91130390 msgr2=0x555d910e6cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:00.814 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:00.819 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:00.819 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.42 2024-09-16T11:18:01.011 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.006+0000 7f9484897700 0 -- 172.21.15.137:0/1411426468 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f9468008980 msgr2=0x7f946800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:01.012 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.43 2024-09-16T11:18:01.188 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.182+0000 7f43f8c88700 0 -- 172.21.15.137:0/2522179478 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f43d803a620 msgr2=0x7f43d803ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:01.200 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.44 2024-09-16T11:18:01.393 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.390+0000 7efd242f0700 0 -- 172.21.15.137:0/1916832446 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7efd08008980 msgr2=0x7efd0800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:01.395 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.399 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.399 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.45 2024-09-16T11:18:01.567 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.562+0000 7f7ba52eb700 0 -- 172.21.15.137:0/4089606235 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f7b84006250 msgr2=0x7f7b84008700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:01.567 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.46 2024-09-16T11:18:01.750 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.746+0000 7f8039624700 0 -- 172.21.15.137:0/4000719323 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x561d4fa21850 msgr2=0x561d4fac2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:01.753 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.757 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.757 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.47 2024-09-16T11:18:01.940 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:01.934+0000 7f0e2a531700 0 -- 172.21.15.137:0/526744805 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0e10008980 msgr2=0x7f0e1000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:01.941 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:01.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:01.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.48 2024-09-16T11:18:02.122 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:02.118+0000 7fe34ec28700 0 -- 172.21.15.137:0/4168483191 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fe32c006730 msgr2=0x7fe32c012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:02.122 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.49 2024-09-16T11:18:02.312 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:02.306+0000 7f70d9e07700 0 -- 172.21.15.137:0/1978341606 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x559e9afa02a0 msgr2=0x559e9af8ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:02.312 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:02.316 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:02.316 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.50 2024-09-16T11:18:02.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:02.494+0000 7f5ca883f700 0 -- 172.21.15.137:0/3276811648 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f5c8c008980 msgr2=0x7f5c8c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:02.501 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:02.506 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:02.506 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.51 2024-09-16T11:18:02.681 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:02.674+0000 7f9c26cfa700 0 -- 172.21.15.137:0/3076332630 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f9c0c006700 msgr2=0x7f9c0c010510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:02.681 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:02.685 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:02.685 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.52 2024-09-16T11:18:02.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:02.854+0000 7ff0152f9700 0 -- 172.21.15.137:0/2145313693 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7feff0008980 msgr2=0x7feff000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:02.859 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:02.864 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:02.864 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.53 2024-09-16T11:18:03.050 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:03.046+0000 7f3e5aaab700 0 -- 172.21.15.137:0/3759250861 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3e40006730 msgr2=0x7f3e40012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:03.051 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:03.056 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:03.057 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.54 2024-09-16T11:18:03.220 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:03.214+0000 7fec0f0a8700 0 -- 172.21.15.137:0/3946878043 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7febf403a620 msgr2=0x7febf403ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:03.255 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:03.260 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:03.260 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.55 2024-09-16T11:18:03.453 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:03.446+0000 7f222de30700 0 -- 172.21.15.137:0/144181128 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f220c008af0 msgr2=0x7f220c00af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:03.453 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:03.458 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:03.458 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.56 2024-09-16T11:18:03.650 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:03.646+0000 7ff8f651a700 0 -- 172.21.15.137:0/1564953850 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff8dc008980 msgr2=0x7ff8dc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:03.650 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:03.654 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:03.654 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.57 2024-09-16T11:18:03.833 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:03.826+0000 7f90a6045700 0 -- 172.21.15.137:0/3634320419 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f9080005fd0 msgr2=0x7f9080008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:03.833 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:03.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:03.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.58 2024-09-16T11:18:04.027 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.022+0000 7f4b42bfe700 0 -- 172.21.15.137:0/2304769423 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f4b28006730 msgr2=0x7f4b28012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:04.027 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:04.032 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:04.032 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.59 2024-09-16T11:18:04.208 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.202+0000 7f3745b61700 0 -- 172.21.15.137:0/1218905901 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3724008980 msgr2=0x7f372400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:04.223 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:04.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:04.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.60 2024-09-16T11:18:04.416 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.410+0000 7feb57ad9700 0 -- 172.21.15.137:0/2352581150 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7feb3c006730 msgr2=0x7feb3c012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:04.432 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:04.437 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:04.437 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.61 2024-09-16T11:18:04.630 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.626+0000 7f8d679c8700 0 -- 172.21.15.137:0/2687290894 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f8d4c008980 msgr2=0x7f8d4c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:04.632 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:04.636 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:04.636 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.62 2024-09-16T11:18:04.826 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.822+0000 7f5195ff8700 0 -- 172.21.15.137:0/3434187591 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f5170006760 msgr2=0x7f5170008be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:04.826 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:04.831 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:04.831 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.63 2024-09-16T11:18:04.996 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:04.990+0000 7f7fec468700 0 -- 172.21.15.137:0/3637589414 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55fc4519a650 msgr2=0x55fc451b1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:05.014 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:05.018 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:05.018 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.64 2024-09-16T11:18:05.209 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:05.206+0000 7fa7b7b5a700 0 -- 172.21.15.137:0/2944811879 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fa798005fa0 msgr2=0x7fa798008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:05.210 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:05.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:05.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.65 2024-09-16T11:18:05.394 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:05.390+0000 7f9656d9a700 0 -- 172.21.15.137:0/1945605466 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f9634006730 msgr2=0x7f9634012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:05.394 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:05.398 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:05.398 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.66 2024-09-16T11:18:05.587 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:05.582+0000 7f35135e4700 0 -- 172.21.15.137:0/3752190868 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x561fc5344ab0 msgr2=0x561fc536bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:05.587 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:05.592 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:05.592 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.67 2024-09-16T11:18:05.796 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:05.790+0000 7f2a73403700 0 -- 172.21.15.137:0/892711751 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x563780e72010 msgr2=0x563780e723e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:05.798 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:05.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:05.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.68 2024-09-16T11:18:06.003 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:05.998+0000 7f262b942700 0 -- 172.21.15.137:0/1637921039 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f2610008980 msgr2=0x7f261000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:06.003 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.69 2024-09-16T11:18:06.206 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:06.202+0000 7f710ff2f700 0 -- 172.21.15.137:0/677183928 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f70f4008980 msgr2=0x7f70f400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:06.207 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.212 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.212 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.70 2024-09-16T11:18:06.400 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:06.394+0000 7f9d78127700 0 -- 172.21.15.137:0/3407643124 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5630515feee0 msgr2=0x5630515fc960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:06.401 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.71 2024-09-16T11:18:06.610 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:06.606+0000 7f24df0ec700 0 -- 172.21.15.137:0/3067537057 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f24c4008980 msgr2=0x7f24c400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:06.612 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.72 2024-09-16T11:18:06.802 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:06.798+0000 7f4053f9c700 0 -- 172.21.15.137:0/879631283 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556a023d5280 msgr2=0x556a023ecb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:06.805 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.809 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.810 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.73 2024-09-16T11:18:06.985 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:06.978+0000 7fd47f42e700 0 -- 172.21.15.137:0/1992508971 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55f252e6cd90 msgr2=0x55f252e93a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:06.986 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:06.991 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:06.991 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.74 2024-09-16T11:18:07.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:07.162+0000 7f0a8d180700 0 -- 172.21.15.137:0/3571611133 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x563ae1c67280 msgr2=0x563ae1c7eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:07.179 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:07.184 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:07.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.75 2024-09-16T11:18:07.371 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:07.366+0000 7f09b2f11700 0 -- 172.21.15.137:0/338074705 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0998016570 msgr2=0x7f0998010550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:07.372 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:07.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:07.377 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.76 2024-09-16T11:18:07.588 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:07.578+0000 7f72fd9b9700 0 -- 172.21.15.137:0/376299144 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f72e4008980 msgr2=0x7f72e400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:07.588 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:07.590 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:07.591 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.77 2024-09-16T11:18:07.779 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:07.774+0000 7ff65840f700 0 -- 172.21.15.137:0/4012610303 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff6300060e0 msgr2=0x7ff630008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:07.779 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:07.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:07.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.78 2024-09-16T11:18:07.965 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:07.962+0000 7f39a113b700 0 -- 172.21.15.137:0/3932648053 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f397c008980 msgr2=0x7f397c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:07.967 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:07.972 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:07.972 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.79 2024-09-16T11:18:08.156 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:08.150+0000 7fb07f647700 0 -- 172.21.15.137:0/2137410095 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55aa99b70290 msgr2=0x55aa99b459d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:08.157 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:08.163 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:08.163 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.80 2024-09-16T11:18:08.336 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:08.330+0000 7f730758f700 0 -- 172.21.15.137:0/3822580308 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f72ec008980 msgr2=0x7f72ec00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:08.337 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:08.341 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:08.341 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.81 2024-09-16T11:18:08.537 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:08.530+0000 7fa8ff6e5700 0 -- 172.21.15.137:0/2449080662 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fa8e4008980 msgr2=0x7fa8e400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:08.538 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:08.543 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:08.543 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.82 2024-09-16T11:18:08.727 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:08.722+0000 7ff9412d7700 0 -- 172.21.15.137:0/555488735 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff92403a6f0 msgr2=0x7ff92403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:08.745 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:08.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:08.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.83 2024-09-16T11:18:08.936 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:08.930+0000 7feb4c19f700 0 -- 172.21.15.137:0/2618278682 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x562835e7c2d0 msgr2=0x562835e326f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:08.936 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:08.941 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:08.941 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.84 2024-09-16T11:18:09.140 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:09.134+0000 7efd749de700 0 -- 172.21.15.137:0/1284726744 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7efd58008980 msgr2=0x7efd5800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:09.140 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:09.145 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:09.145 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.85 2024-09-16T11:18:09.319 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:09.314+0000 7f94f488a700 0 -- 172.21.15.137:0/2776163509 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5599a700cf30 msgr2=0x5599a70b5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:09.325 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:09.330 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:09.330 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.86 2024-09-16T11:18:09.547 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:09.542+0000 7fc9c9eb2700 0 -- 172.21.15.137:0/2674658485 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5648bac6f410 msgr2=0x5648bac4cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:09.547 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:09.553 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:09.553 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.87 2024-09-16T11:18:09.946 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:09.942+0000 7fd03fcf1700 0 -- 172.21.15.137:0/2322500422 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fd018005fa0 msgr2=0x7fd018008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:09.953 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:09.958 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:09.958 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.88 2024-09-16T11:18:10.133 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:10.126+0000 7f596f6d7700 0 -- 172.21.15.137:0/81679887 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f5954008980 msgr2=0x7f595400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:10.133 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:10.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:10.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.89 2024-09-16T11:18:10.307 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:10.302+0000 7fdcb3aa5700 0 -- 172.21.15.137:0/1342594586 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7fdc9403a6e0 msgr2=0x7fdc9403cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:10.326 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:10.331 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:10.331 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.90 2024-09-16T11:18:10.520 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:10.514+0000 7ff470b19700 0 -- 172.21.15.137:0/606658628 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff454006730 msgr2=0x7ff454012840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:10.520 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:10.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:10.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.91 2024-09-16T11:18:10.714 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:10.719 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:10.720 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.92 2024-09-16T11:18:10.888 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:10.882+0000 7f4a40a94700 0 -- 172.21.15.137:0/2578923654 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5593b363e850 msgr2=0x5593b36df820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:10.891 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:10.896 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:10.896 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.93 2024-09-16T11:18:11.081 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:11.074+0000 7f3b57ce6700 0 -- 172.21.15.137:0/1901255614 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5573d63b5630 msgr2=0x5573d645d4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:11.093 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:11.098 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.94 2024-09-16T11:18:11.287 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:11.282+0000 7f36cf8bb700 0 -- 172.21.15.137:0/3719501359 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f36b40067a0 msgr2=0x7f36b4012850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:11.289 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:11.293 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:11.293 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.95 2024-09-16T11:18:11.480 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:11.474+0000 7f11e24fe700 0 -- 172.21.15.137:0/3209734110 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f11c8008980 msgr2=0x7f11c800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:11.480 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:11.485 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:11.485 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.96 2024-09-16T11:18:11.662 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:11.658+0000 7f6442730700 0 -- 172.21.15.137:0/228871572 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f642403a6f0 msgr2=0x7f642403cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:11.674 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:11.678 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:11.679 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.97 2024-09-16T11:18:11.858 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:11.854+0000 7fee4e844700 0 -- 172.21.15.137:0/1259381557 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fee34008af0 msgr2=0x7fee3400af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:11.858 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:11.863 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:11.863 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.98 2024-09-16T11:18:12.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:12.058+0000 7fa8cd747700 0 -- 172.21.15.137:0/3504168826 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fa8ac005fb0 msgr2=0x7fa8ac008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:12.065 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:12.070 INFO:tasks.workunit.client.0.smithi137.stderr:+ for i in $(seq -w 00 99) 2024-09-16T11:18:12.070 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm image.99 2024-09-16T11:18:12.467 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:12.462+0000 7fcf64d8d700 0 -- 172.21.15.137:0/1319677621 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x560f5973c280 msgr2=0x560f59753b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:12.471 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:12.476 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_remove 2024-09-16T11:18:12.477 INFO:tasks.workunit.client.0.smithi137.stdout:testing remove... 2024-09-16T11:18:12.477 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing remove...' 2024-09-16T11:18:12.477 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:18:12.477 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:12.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:12.725 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:12.854 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:12.974 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.094 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.340 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.465 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.586 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:13.959 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.077 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.317 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.434 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.552 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:14.676 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd remove NOT_EXIST 2024-09-16T11:18:14.745 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 0% complete...failed. 2024-09-16T11:18:14.746 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: delete error: (2) No such file or directory 2024-09-16T11:18:14.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:14.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-16T11:18:14.774 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:14.788 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:14.782+0000 7fa3fd4ea4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:14.800 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:18:14.863 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:14.868 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:18:14.868 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:18:14.868 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:18:14.909 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:18:14.909 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-16T11:18:14.981 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:15.154 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:15.150+0000 7fddcfed7700 0 -- 172.21.15.137:0/263426118 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fddb4008980 msgr2=0x7fddb400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:15.154 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:15.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:18:15.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:18:15.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:18:15.198 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:18:15.199 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 1 test1 2024-09-16T11:18:15.229 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:15.242 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:15.238+0000 7f4572f374c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:15.256 INFO:tasks.workunit.client.0.smithi137.stderr:+ rados rm -p rbd test1.rbd 2024-09-16T11:18:15.304 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:18:15.357 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:15.362 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:18:15.363 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:18:15.363 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:18:15.406 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:18:15.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 1 -eq 0 ']' 2024-09-16T11:18:15.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-16T11:18:15.473 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test2@snap 2024-09-16T11:18:16.754 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:18:16.768 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect test2@snap 2024-09-16T11:18:16.834 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2024-09-16T11:18:16.937 INFO:tasks.workunit.client.0.smithi137.stderr:+ rados -p rbd rm rbd_children 2024-09-16T11:18:16.982 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm clone 2024-09-16T11:18:17.168 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:17.162+0000 7f3c34ebb700 0 -- 172.21.15.137:0/73973928 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f3c18008980 msgr2=0x7f3c1800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:17.169 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:17.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:18:17.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone 2024-09-16T11:18:17.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:18:17.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:18:17.220 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:18:17.220 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect test2@snap 2024-09-16T11:18:17.293 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm test2@snap 2024-09-16T11:18:17.760 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:18:17.772 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:17.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:17.942+0000 7f441097e700 0 -- 172.21.15.137:0/2182823897 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x563bd44d6ac0 msgr2=0x563bd451f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:17.949 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:17.955 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_migration 2024-09-16T11:18:17.955 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing migration...' 2024-09-16T11:18:17.956 INFO:tasks.workunit.client.0.smithi137.stdout:testing migration... 2024-09-16T11:18:17.956 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:18:17.956 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.084 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.207 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.329 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.453 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.580 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:18.706 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.044 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.162 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.291 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.417 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.542 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.666 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.788 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:19.915 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:20.033 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:20.162 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:20.292 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:20.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool create rbd2 8 2024-09-16T11:18:20.902 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' already exists 2024-09-16T11:18:20.910 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd pool init rbd2 2024-09-16T11:18:24.370 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 1 -s 128M test1 2024-09-16T11:18:24.398 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:24.410 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:24.406+0000 7f41b5e264c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:18:24.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'format: 1' 2024-09-16T11:18:24.474 INFO:tasks.workunit.client.0.smithi137.stdout: format: 1 2024-09-16T11:18:24.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 --image-format 2 2024-09-16T11:18:24.596 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state test1 2024-09-16T11:18:24.596 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=test1 2024-09-16T11:18:24.596 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status test1 2024-09-16T11:18:24.596 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:24.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ test prepared = prepared 2024-09-16T11:18:24.731 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:18:24.731 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'format: 2' 2024-09-16T11:18:24.797 INFO:tasks.workunit.client.0.smithi137.stdout: format: 2 2024-09-16T11:18:24.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:18:24.851 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:24.846+0000 7fbe3a3464c0 -1 librbd::image::PreRemoveRequest: 0x55639a711360 validate_image_removal: image in migration state - not removing 2024-09-16T11:18:24.855 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 0% complete...failed. 2024-09-16T11:18:24.855 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: error: image still has watchers 2024-09-16T11:18:24.855 INFO:tasks.workunit.client.0.smithi137.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2024-09-16T11:18:24.859 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:24.859 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:25.030 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete...2024-09-16T11:18:25.026+0000 7efe831ff700 0 -- 172.21.15.137:0/2531563224 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x559074796e80 msgr2=0x559074888d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.049 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:25.046+0000 7efe829fe700 0 -- 172.21.15.137:0/2531563224 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7efe68008980 msgr2=0x7efe6800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.084 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:25.090 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state test1 2024-09-16T11:18:25.090 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=test1 2024-09-16T11:18:25.090 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status test1 2024-09-16T11:18:25.090 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:25.194 INFO:tasks.workunit.client.0.smithi137.stderr:+ test executed = executed 2024-09-16T11:18:25.194 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:25.359 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete...2024-09-16T11:18:25.354+0000 7f5dabaad700 0 -- 172.21.15.137:0/1351022232 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5561aba58800 msgr2=0x5561abab9e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.372 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-16T11:18:25.366+0000 7f5dab2ac700 0 -- 172.21.15.137:0/1351022232 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f5d90008980 msgr2=0x7f5d9000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.385 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:25.389 INFO:tasks.workunit.client.0.smithi137.stderr:+ get_migration_state test1 2024-09-16T11:18:25.389 INFO:tasks.workunit.client.0.smithi137.stderr:+ local image=test1 2024-09-16T11:18:25.390 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --format xml status test1 2024-09-16T11:18:25.390 INFO:tasks.workunit.client.0.smithi137.stderr:+ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:25.444 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:25.445 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:18:25.445 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'features: .*layering' 2024-09-16T11:18:25.504 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:25.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2024-09-16T11:18:25.669 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:18:25.669 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'features: .*layering' 2024-09-16T11:18:25.738 INFO:tasks.workunit.client.0.smithi137.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2024-09-16T11:18:25.738 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:25.879 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:25.874+0000 7fad101c5700 0 -- 172.21.15.137:0/3693558392 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55ea9f9763a0 msgr2=0x55ea9f9d7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.902 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:25.898+0000 7fad0f9c4700 0 -- 172.21.15.137:0/3693558392 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7facf4008980 msgr2=0x7facf400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:25.912 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:25.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:26.293 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:26.290+0000 7f4e47789700 0 -- 172.21.15.137:0/3466132628 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f4e2c008980 msgr2=0x7f4e2c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:26.308 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete...2024-09-16T11:18:26.302+0000 7f4e47789700 0 -- 172.21.15.137:0/3466132628 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f4e2c008980 msgr2=0x7f4e2803d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:26.346 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2024-09-16T11:18:26.351 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 rbd2/test1 2024-09-16T11:18:26.526 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:26.522+0000 7f6ffbb01700 0 -- 172.21.15.137:0/346474235 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f6fd8008980 msgr2=0x7f6fd800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:26.541 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state rbd2/test1 2024-09-16T11:18:26.541 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=rbd2/test1 2024-09-16T11:18:26.542 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status rbd2/test1 2024-09-16T11:18:26.542 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:26.689 INFO:tasks.workunit.client.0.smithi137.stderr:+ test prepared = prepared 2024-09-16T11:18:26.690 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:18:26.690 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:18:26.690 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:18:26.733 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:18:26.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls 2024-09-16T11:18:26.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:18:26.777 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:18:26.777 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:26.940 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:26.934+0000 7f0f800f3700 0 -- 172.21.15.137:0/1443199720 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55e8b5c904a0 msgr2=0x55e8b5c92880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:26.951 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:26.956 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state rbd2/test1 2024-09-16T11:18:26.957 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=rbd2/test1 2024-09-16T11:18:26.957 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status rbd2/test1 2024-09-16T11:18:26.957 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:27.065 INFO:tasks.workunit.client.0.smithi137.stderr:+ test executed = executed 2024-09-16T11:18:27.065 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm rbd2/test1 2024-09-16T11:18:27.126 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:27.122+0000 7f70e7fff700 -1 librbd::image::PreRemoveRequest: 0x55a1b24876d0 validate_image_removal: image in migration state - not removing 2024-09-16T11:18:27.136 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 0% complete...failed. 2024-09-16T11:18:27.136 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: error: image still has watchers 2024-09-16T11:18:27.136 INFO:tasks.workunit.client.0.smithi137.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2024-09-16T11:18:27.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:27.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:27.297 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-16T11:18:27.294+0000 7fcf66e14700 0 -- 172.21.15.137:0/4117278942 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55ff31abe1f0 msgr2=0x55ff31ac05d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:27.316 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:27.321 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create rbd2/ns1 2024-09-16T11:18:27.372 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create rbd2/ns2 2024-09-16T11:18:27.419 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2024-09-16T11:18:27.582 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:27.578+0000 7f823fed0700 0 -- 172.21.15.137:0/2629143455 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f8224008980 msgr2=0x7f822400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:27.595 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state rbd2/ns1/test1 2024-09-16T11:18:27.595 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=rbd2/ns1/test1 2024-09-16T11:18:27.595 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status rbd2/ns1/test1 2024-09-16T11:18:27.596 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:27.732 INFO:tasks.workunit.client.0.smithi137.stderr:+ test prepared = prepared 2024-09-16T11:18:27.732 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute rbd2/test1 2024-09-16T11:18:27.851 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:27.846+0000 7f7471e4f700 0 -- 172.21.15.137:0/1825737777 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556cfb4f2440 msgr2=0x556cfb4f4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:27.858 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:27.864 INFO:tasks.workunit.client.0.smithi137.stderr:++ get_migration_state rbd2/ns1/test1 2024-09-16T11:18:27.864 INFO:tasks.workunit.client.0.smithi137.stderr:++ local image=rbd2/ns1/test1 2024-09-16T11:18:27.864 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd --format xml status rbd2/ns1/test1 2024-09-16T11:18:27.864 INFO:tasks.workunit.client.0.smithi137.stderr:++ xmlstarlet sel -t -v //status/migration/state 2024-09-16T11:18:28.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ test executed = executed 2024-09-16T11:18:28.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit rbd2/test1 2024-09-16T11:18:28.337 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-16T11:18:28.334+0000 7fbb7ef2a700 0 -- 172.21.15.137:0/519250680 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55c200a91360 msgr2=0x55c200a93740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.355 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:28.360 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2024-09-16T11:18:28.511 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:28.506+0000 7feef04ab700 0 -- 172.21.15.137:0/1280492345 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55959e5380b0 msgr2=0x55959e5dc290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute rbd2/ns2/test1 2024-09-16T11:18:28.652 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:28.646+0000 7f9cb027f700 0 -- 172.21.15.137:0/4060329115 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x564c0b6d5250 msgr2=0x564c0b6d7630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.669 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:28.666+0000 7f9cb0a80700 0 -- 172.21.15.137:0/4060329115 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x564c0b5e1ff0 msgr2=0x564c0b6876a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.670 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:28.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit rbd2/ns2/test1 2024-09-16T11:18:28.828 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:28.822+0000 7f6c88930700 0 -- 172.21.15.137:0/1484546419 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5628a4c6e320 msgr2=0x5628a4c70700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.842 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-16T11:18:28.838+0000 7f6c89131700 0 -- 172.21.15.137:0/1484546419 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5628a4c04a60 msgr2=0x5628a4c20ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:28.862 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:28.868 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M test1 2024-09-16T11:18:28.908 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:28.902+0000 7fc64ad5f4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:28.920 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 --data-pool rbd2 2024-09-16T11:18:29.045 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:18:29.045 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'data_pool: rbd2' 2024-09-16T11:18:29.110 INFO:tasks.workunit.client.0.smithi137.stdout: data_pool: rbd2 2024-09-16T11:18:29.111 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:29.259 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:29.254+0000 7ff0e7bc2700 0 -- 172.21.15.137:0/1670488227 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7ff0cc008980 msgr2=0x7ff0cc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:29.286 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.282+0000 7ff0e83c3700 0 -- 172.21.15.137:0/1670488227 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x563e821e33e0 msgr2=0x563e82241a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:29.301 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:29.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:29.471 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete...2024-09-16T11:18:29.466+0000 7f1554872700 0 -- 172.21.15.137:0/3616094290 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f1530008980 msgr2=0x7f153000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:29.484 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2024-09-16T11:18:29.478+0000 7f1554872700 0 -- 172.21.15.137:0/3616094290 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f153803ad20 msgr2=0x7f153803d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:29.497 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:29.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 2024-09-16T11:18:29.648 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd trash mv test1 2024-09-16T11:18:29.648 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv test1 2024-09-16T11:18:29.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.702+0000 7f81a12024c0 -1 librbd::api::Trash: move: cannot move migrating image to trash 2024-09-16T11:18:29.709 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: deferred delete error: (16) Device or resource busy 2024-09-16T11:18:29.714 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:29.715 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls -a 2024-09-16T11:18:29.715 INFO:tasks.workunit.client.0.smithi137.stderr:++ cut -d ' ' -f 1 2024-09-16T11:18:29.760 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=19ea5be364a4 2024-09-16T11:18:29.761 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd trash rm 19ea5be364a4 2024-09-16T11:18:29.761 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm 19ea5be364a4 2024-09-16T11:18:29.815 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.810+0000 7fe12bfff700 -1 librbd::image::RefreshRequest: image being migrated 2024-09-16T11:18:29.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.810+0000 7fe12b7fe700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2024-09-16T11:18:29.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.810+0000 7fe12bfff700 -1 librbd::ImageState: 0x7fe10804def0 failed to open image: (30) Read-only file system 2024-09-16T11:18:29.816 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.810+0000 7fe11a7fc700 -1 librbd::image::RemoveRequest: 0x7fe108000b80 handle_open_image: error opening image: (30) Read-only file system 2024-09-16T11:18:29.819 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: remove error: (30) Read-only file system 2024-09-16T11:18:29.819 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 0% complete...failed. 2024-09-16T11:18:29.824 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:29.824 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd trash restore 19ea5be364a4 2024-09-16T11:18:29.824 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash restore 19ea5be364a4 2024-09-16T11:18:29.862 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: restore error: (22) Invalid argument 2024-09-16T11:18:29.862 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:29.858+0000 7fa3b4def4c0 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2024-09-16T11:18:29.866 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:29.866 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test1 2024-09-16T11:18:30.022 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:30.018+0000 7f5ef7f9e700 0 -- 172.21.15.137:0/1693778781 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f5ed4008980 msgr2=0x7f5ed400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:30.063 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:30.058+0000 7f5ef879f700 0 -- 172.21.15.137:0/1693778781 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x563bb09abfc0 msgr2=0x563bb0aa1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:30.077 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:30.082 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd remove test1 2024-09-16T11:18:30.230 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:30.235 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/dev/urandom bs=1M count=1 2024-09-16T11:18:30.235 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd --image-format 2 import - test1 2024-09-16T11:18:30.314 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records in 2024-09-16T11:18:30.314 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records out 2024-09-16T11:18:30.314 INFO:tasks.workunit.client.0.smithi137.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0775658 s, 13.5 MB/s 2024-09-16T11:18:30.369 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 100% complete...done. 2024-09-16T11:18:30.373 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export test1 - 2024-09-16T11:18:30.373 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:30.633 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:30.639 INFO:tasks.workunit.client.0.smithi137.stderr:+ md5sum='500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:30.639 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@snap1 2024-09-16T11:18:31.386 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:18:31.400 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect test1@snap1 2024-09-16T11:18:31.467 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@snap2 2024-09-16T11:18:32.374 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:18:32.385 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2024-09-16T11:18:32.500 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2024-09-16T11:18:32.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v1 2024-09-16T11:18:32.617 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd/test1@snap1' 2024-09-16T11:18:32.699 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd/test1@snap1 2024-09-16T11:18:32.699 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:32.699 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd/test1@snap2' 2024-09-16T11:18:32.774 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd/test1@snap2 2024-09-16T11:18:32.774 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:32.775 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'op_features: clone-child' 2024-09-16T11:18:32.851 INFO:tasks.workunit.client.0.smithi137.stdout: op_features: clone-child 2024-09-16T11:18:32.853 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v1 - 2024-09-16T11:18:32.853 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:32.930 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:32.938 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:32.939 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v2 - 2024-09-16T11:18:32.939 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:33.011 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:33.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:33.018 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children test1@snap1 2024-09-16T11:18:33.095 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-16T11:18:33.095 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children test1@snap2 2024-09-16T11:18:33.157 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-16T11:18:33.157 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test1 rbd2/test2 2024-09-16T11:18:33.315 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:33.310+0000 7f3e623b6700 0 -- 172.21.15.137:0/197350372 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f3e4403acc0 msgr2=0x7f3e4403d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:33.380 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:33.374+0000 7f3e623b6700 0 -- 172.21.15.137:0/197350372 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f3e48008980 msgr2=0x7f3e4403db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:34.529 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v1 2024-09-16T11:18:34.529 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2024-09-16T11:18:34.627 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd2/test2@snap1 2024-09-16T11:18:34.628 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:34.628 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2024-09-16T11:18:34.741 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd2/test2@snap2 2024-09-16T11:18:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:34.742 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'op_features: clone-child' 2024-09-16T11:18:34.842 INFO:tasks.workunit.client.0.smithi137.stdout: op_features: clone-child 2024-09-16T11:18:34.842 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children rbd2/test2@snap1 2024-09-16T11:18:34.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-16T11:18:34.961 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children rbd2/test2@snap2 2024-09-16T11:18:35.062 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-16T11:18:35.062 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:35.210 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:35.215 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd migration commit test1 2024-09-16T11:18:35.215 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:35.338 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: the image has descendants: 2024-09-16T11:18:35.339 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v1 2024-09-16T11:18:35.339 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v2 2024-09-16T11:18:35.339 INFO:tasks.workunit.client.0.smithi137.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-16T11:18:35.339 INFO:tasks.workunit.client.0.smithi137.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2024-09-16T11:18:35.344 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:35.344 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 --force 2024-09-16T11:18:35.479 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: the image has descendants: 2024-09-16T11:18:35.479 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v1 2024-09-16T11:18:35.479 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v2 2024-09-16T11:18:35.479 INFO:tasks.workunit.client.0.smithi137.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-16T11:18:35.479 INFO:tasks.workunit.client.0.smithi137.stderr:Proceeding anyway due to force flag set. 2024-09-16T11:18:35.500 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:35.494+0000 7f7d26f4d700 0 -- 172.21.15.137:0/333675121 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55e97947bd20 msgr2=0x55e97947e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:35.517 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:35.510+0000 7f7d26f4d700 0 -- 172.21.15.137:0/333675121 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f7d0803ae60 msgr2=0x7f7d0803d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:37.449 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:37.455 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v1 - 2024-09-16T11:18:37.455 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:37.527 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:37.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:37.535 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v2 - 2024-09-16T11:18:37.536 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:37.608 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:37.615 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:37.615 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare rbd2/test2 test1 2024-09-16T11:18:37.777 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:37.770+0000 7f3b006ac700 0 -- 172.21.15.137:0/2828218725 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f3ae003aef0 msgr2=0x7f3ae003d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:38.420 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:38.414+0000 7f3b006ac700 0 -- 172.21.15.137:0/2828218725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559e2de97180 msgr2=0x559e2ddfef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v1 2024-09-16T11:18:39.558 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd/test1@snap1' 2024-09-16T11:18:39.655 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd/test1@snap1 2024-09-16T11:18:39.655 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:39.656 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'parent: rbd/test1@snap2' 2024-09-16T11:18:39.756 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd/test1@snap2 2024-09-16T11:18:39.756 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info clone_v2 2024-09-16T11:18:39.757 INFO:tasks.workunit.client.0.smithi137.stderr:+ fgrep 'op_features: clone-child' 2024-09-16T11:18:39.856 INFO:tasks.workunit.client.0.smithi137.stdout: op_features: clone-child 2024-09-16T11:18:39.856 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children test1@snap1 2024-09-16T11:18:39.955 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2024-09-16T11:18:39.956 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd children test1@snap2 2024-09-16T11:18:40.052 INFO:tasks.workunit.client.0.smithi137.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2024-09-16T11:18:40.052 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test1 2024-09-16T11:18:40.228 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:40.222+0000 7fc226494700 0 -- 172.21.15.137:0/3157597252 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7fc20c008980 msgr2=0x7fc20c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:40.234 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:40.239 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd migration commit test1 2024-09-16T11:18:40.239 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 2024-09-16T11:18:40.394 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: the image has descendants: 2024-09-16T11:18:40.394 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v1 2024-09-16T11:18:40.394 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v2 2024-09-16T11:18:40.394 INFO:tasks.workunit.client.0.smithi137.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-16T11:18:40.394 INFO:tasks.workunit.client.0.smithi137.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2024-09-16T11:18:40.399 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:40.399 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration commit test1 --force 2024-09-16T11:18:40.538 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: the image has descendants: 2024-09-16T11:18:40.539 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v1 2024-09-16T11:18:40.539 INFO:tasks.workunit.client.0.smithi137.stderr: rbd/clone_v2 2024-09-16T11:18:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2024-09-16T11:18:40.539 INFO:tasks.workunit.client.0.smithi137.stderr:Proceeding anyway due to force flag set. 2024-09-16T11:18:40.542 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:40.538+0000 7fdf969bf700 0 -- 172.21.15.137:0/1607520565 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7fdf7c008980 msgr2=0x7fdf7c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:40.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:40.558+0000 7fdf969bf700 0 -- 172.21.15.137:0/1607520565 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7fdf7803ade0 msgr2=0x7fdf7803d200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:42.425 INFO:tasks.workunit.client.0.smithi137.stderr: Commit image migration: 100% complete...done. 2024-09-16T11:18:42.432 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v1 - 2024-09-16T11:18:42.432 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:42.506 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:42.512 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:42.513 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export clone_v2 - 2024-09-16T11:18:42.513 INFO:tasks.workunit.client.0.smithi137.stderr:++ md5sum 2024-09-16T11:18:42.591 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:18:42.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ test '500071671fc10ee2f1881ca3d7eb914a -' = '500071671fc10ee2f1881ca3d7eb914a -' 2024-09-16T11:18:42.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd remove clone_v1 2024-09-16T11:18:42.791 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:42.786+0000 7f1f5f0b5700 0 -- 172.21.15.137:0/2571646771 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x564674848280 msgr2=0x56467485fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:42.794 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:42.800 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd remove clone_v2 2024-09-16T11:18:42.973 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:42.970+0000 7fc930212700 0 -- 172.21.15.137:0/3268618638 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55871cb59650 msgr2=0x55871cb70640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:42.986 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:42.990 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect test1@snap1 2024-09-16T11:18:43.062 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge test1 2024-09-16T11:18:44.451 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:18:44.467 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:18:44.654 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:44.650+0000 7fecc9d70700 0 -- 172.21.15.137:0/3259406028 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7feca40060e0 msgr2=0x7feca4008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:44.661 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:44.666 INFO:tasks.workunit.client.0.smithi137.stderr:+ for format in 1 2 2024-09-16T11:18:44.666 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-16T11:18:44.695 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:44.709 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:44.702+0000 7f80978da4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:44.719 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-16T11:18:44.860 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:45.128 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:45.134 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:45.134 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:45.145 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:45.265 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:45.262+0000 7f2877296700 0 -- 172.21.15.137:0/1727098123 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55fc6896d3a0 msgr2=0x55fc689ce740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:45.293 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:45.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:45.352 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:45.356 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:45.356 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.004 bytes/sec: 250 KiB/s 2024-09-16T11:18:45.364 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:45.446 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:45.450 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-16T11:18:45.479 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:45.490 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:45.486+0000 7feba85544c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:45.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-16T11:18:45.637 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:45.712 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:45.722 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:45.722 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 83.3348 bytes/sec: 83 KiB/s 2024-09-16T11:18:45.732 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test2 2024-09-16T11:18:45.896 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:45.890+0000 7efea6ac1700 0 -- 172.21.15.137:0/3176365477 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7efe80008a60 msgr2=0x7efe8001bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:45.926 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:45.922+0000 7efea72c2700 0 -- 172.21.15.137:0/3176365477 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55c3be862660 msgr2=0x55c3be952b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:45.934 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:45.938 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:46.051 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:46.046+0000 7f34b9993700 0 -- 172.21.15.137:0/4028394950 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x558d0712b610 msgr2=0x558d0721be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:46.083 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:46.089 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:46.145 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:46.149 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:46.149 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:46.157 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:46.241 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:46.245 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-16T11:18:46.271 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:46.283 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:46.278+0000 7ff94c6704c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:46.294 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2024-09-16T11:18:46.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:46.362+0000 7fa598c204c0 -1 librbd::image::CreateRequest: 0x5566d8de29d0 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2024-09-16T11:18:46.367 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:46.362+0000 7fa598c204c0 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2024-09-16T11:18:46.381 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: preparing migration failed: (2) No such file or directory 2024-09-16T11:18:46.387 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:46.387 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:46.442 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:46.446 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:46.446 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.004 bytes/sec: 250 KiB/s 2024-09-16T11:18:46.454 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:46.527 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:46.530 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-16T11:18:46.555 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:46.564 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:46.558+0000 7f8b68dd94c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:46.579 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-16T11:18:46.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2024-09-16T11:18:46.756 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:46.763 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:46.763 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:46.771 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:46.890 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-16T11:18:46.894 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:46.949 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:46.954 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:46.954 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.004 bytes/sec: 250 KiB/s 2024-09-16T11:18:46.963 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:47.045 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:47.049 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 1 test2 2024-09-16T11:18:47.077 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image format 1 is deprecated 2024-09-16T11:18:47.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:47.082+0000 7f5c27ea54c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-16T11:18:47.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort rbd2/test2 2024-09-16T11:18:47.340 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:47.334+0000 7f5d9048a700 0 -- 172.21.15.137:0/3059935249 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f5d74008980 msgr2=0x7f5d7400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:47.364 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:47.368 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:47.419 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:47.431 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:47.431 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 83.3348 bytes/sec: 83 KiB/s 2024-09-16T11:18:47.440 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:47.522 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:18:47.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ test 1 = 1 2024-09-16T11:18:47.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ continue 2024-09-16T11:18:47.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ for format in 1 2 2024-09-16T11:18:47.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:47.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-16T11:18:47.783 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:47.778+0000 7f6a1e084700 0 -- 172.21.15.137:0/2851519988 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x562875844ed0 msgr2=0x56287594fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:47.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:47.884 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:47.894 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:47.894 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 83.3348 bytes/sec: 83 KiB/s 2024-09-16T11:18:47.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:48.107 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:48.102+0000 7fbfcbfb1700 0 -- 172.21.15.137:0/1278948478 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fbfa8006780 msgr2=0x7fbfa80071b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:48.113 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:48.118 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:48.188 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:48.191 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:48.191 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.004 bytes/sec: 250 KiB/s 2024-09-16T11:18:48.209 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:48.393 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:48.390+0000 7f6746356700 0 -- 172.21.15.137:0/1041363502 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f672803af70 msgr2=0x7f672803d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:48.416 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:48.421 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:48.488 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool rbd2 2024-09-16T11:18:48.663 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:48.658+0000 7f63e07f4700 0 -- 172.21.15.137:0/3218711156 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x564a2b989970 msgr2=0x564a2ba7cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:48.675 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:48.758 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:48.768 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:48.768 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:48.786 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration execute test2 2024-09-16T11:18:48.948 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2024-09-16T11:18:48.942+0000 7ff920c1c700 0 -- 172.21.15.137:0/801430129 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7ff904006780 msgr2=0x7ff904006160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:48.988 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:48.982+0000 7ff92141d700 0 -- 172.21.15.137:0/801430129 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55bf4833b3e0 msgr2=0x55bf48399ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:48.994 INFO:tasks.workunit.client.0.smithi137.stderr: Image migration: 100% complete...done. 2024-09-16T11:18:48.998 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:49.199 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2024-09-16T11:18:49.194+0000 7effb80ba700 0 -- 172.21.15.137:0/1263263920 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7eff98001470 msgr2=0x7eff98008d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:49.205 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 100% complete...done. 2024-09-16T11:18:49.210 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:49.278 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:49.281 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:49.282 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.004 bytes/sec: 250 KiB/s 2024-09-16T11:18:49.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:49.478 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:49.474+0000 7f88ce43d700 0 -- 172.21.15.137:0/250963524 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f88b4008980 msgr2=0x7f88b400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:49.500 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:49.504 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:49.576 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2024-09-16T11:18:49.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:49.706+0000 7f844c3fe4c0 -1 librbd::image::CreateRequest: 0x55aea3fd4bf0 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2024-09-16T11:18:49.710 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:49.706+0000 7f844c3fe4c0 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2024-09-16T11:18:49.758 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: preparing migration failed: (2) No such file or directory 2024-09-16T11:18:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:18:49.765 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:49.836 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:49.846 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:49.846 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 83.3348 bytes/sec: 83 KiB/s 2024-09-16T11:18:49.863 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:50.061 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:50.058+0000 7f766bea5700 0 -- 172.21.15.137:0/17425892 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f76500066d0 msgr2=0x7f7650012950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:50.069 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:50.073 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:50.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-16T11:18:50.326 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:50.322+0000 7fe68551f700 0 -- 172.21.15.137:0/212510646 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fe660008980 msgr2=0x7fe66000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:18:50.337 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2024-09-16T11:18:50.414 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:50.421 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:50.422 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:50.433 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:50.604 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-16T11:18:50.608 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:50.681 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:50.687 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:50.688 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:50.707 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:50.905 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:50.897+0000 7f4e279c1700 0 -- 172.21.15.137:0/3777770446 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55b92375af30 msgr2=0x55b923803490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:50.914 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:50.919 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:50.991 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 rbd2/test2 2024-09-16T11:18:51.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:51.169+0000 7fb5d8b21700 0 -- 172.21.15.137:0/772648075 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fb5bc008980 msgr2=0x7fb5bc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:51.189 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort rbd2/test2 2024-09-16T11:18:51.368 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-16T11:18:51.373 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:51.444 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:51.451 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:51.451 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:51.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:51.663 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:51.657+0000 7fafab85d700 0 -- 172.21.15.137:0/2041921493 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7faf90008980 msgr2=0x7faf9000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:51.675 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:51.680 INFO:tasks.workunit.client.0.smithi137.stderr:+ test 2 = 1 2024-09-16T11:18:51.680 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 128M --image-format 2 test2 2024-09-16T11:18:51.755 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2024-09-16T11:18:51.920 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:51.913+0000 7fd68d64f700 0 -- 172.21.15.137:0/1437834057 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55d5f97851a0 msgr2=0x55d5f9787580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:51.935 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2024-09-16T11:18:52.015 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:52.024 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:52.024 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 125.002 bytes/sec: 125 KiB/s 2024-09-16T11:18:52.042 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd migration abort test2 2024-09-16T11:18:52.226 INFO:tasks.workunit.client.0.smithi137.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2024-09-16T11:18:52.231 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2024-09-16T11:18:52.300 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-16T11:18:52.304 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:18:52.304 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2024-09-16T11:18:52.321 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:18:52.513 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:18:52.509+0000 7f5707ee5700 0 -- 172.21.15.137:0/2188387897 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f56ec0066d0 msgr2=0x7f56ec0127e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:18:52.521 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:52.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:18:52.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:52.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:52.783 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:52.913 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.037 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.365 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.485 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.611 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.871 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:53.998 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.128 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.250 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.372 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.633 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:54.886 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:55.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-16T11:18:55.473 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' does not exist 2024-09-16T11:18:55.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_config 2024-09-16T11:18:55.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing config...' 2024-09-16T11:18:55.482 INFO:tasks.workunit.client.0.smithi137.stdout:testing config... 2024-09-16T11:18:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:18:55.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:55.605 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:55.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:55.869 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.002 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.125 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.247 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.373 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.629 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.761 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:56.893 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.150 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.284 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.411 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:57.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global set osd rbd_cache true 2024-09-16T11:18:57.785 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set osd rbd_cache true 2024-09-16T11:18:57.813 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2024-09-16T11:18:57.814 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:57.814 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global set global debug_ms 10 2024-09-16T11:18:57.814 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set global debug_ms 10 2024-09-16T11:18:57.846 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: not rbd option: debug_ms 2024-09-16T11:18:57.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:57.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2024-09-16T11:18:57.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set global rbd_UNKNOWN false 2024-09-16T11:18:57.879 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: invalid config key: rbd_UNKNOWN 2024-09-16T11:18:57.881 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:57.881 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2024-09-16T11:18:57.881 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set global rbd_cache INVALID 2024-09-16T11:18:57.917 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2024-09-16T11:18:57.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:57.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set global rbd_cache false 2024-09-16T11:18:57.967 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set client rbd_cache true 2024-09-16T11:18:58.010 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global set client.123 rbd_cache false 2024-09-16T11:18:58.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global get global rbd_cache 2024-09-16T11:18:58.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^false$' 2024-09-16T11:18:58.091 INFO:tasks.workunit.client.0.smithi137.stdout:false 2024-09-16T11:18:58.092 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global get client rbd_cache 2024-09-16T11:18:58.092 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^true$' 2024-09-16T11:18:58.131 INFO:tasks.workunit.client.0.smithi137.stdout:true 2024-09-16T11:18:58.132 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global get client.123 rbd_cache 2024-09-16T11:18:58.132 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^false$' 2024-09-16T11:18:58.175 INFO:tasks.workunit.client.0.smithi137.stdout:false 2024-09-16T11:18:58.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2024-09-16T11:18:58.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2024-09-16T11:18:58.209 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: rbd_cache is not set 2024-09-16T11:18:58.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:58.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global list global 2024-09-16T11:18:58.215 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * false * global *$' 2024-09-16T11:18:58.254 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache false global 2024-09-16T11:18:58.255 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global list client 2024-09-16T11:18:58.255 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * client *$' 2024-09-16T11:18:58.298 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true client 2024-09-16T11:18:58.298 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global list client.123 2024-09-16T11:18:58.299 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * false * client.123 *$' 2024-09-16T11:18:58.338 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache false client.123 2024-09-16T11:18:58.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global list client.UNKNOWN 2024-09-16T11:18:58.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * client *$' 2024-09-16T11:18:58.379 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true client 2024-09-16T11:18:58.379 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global rm client rbd_cache 2024-09-16T11:18:58.425 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config global get client rbd_cache 2024-09-16T11:18:58.425 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global get client rbd_cache 2024-09-16T11:18:58.465 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: rbd_cache is not set 2024-09-16T11:18:58.469 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:58.470 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global list client 2024-09-16T11:18:58.470 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * false * global *$' 2024-09-16T11:18:58.514 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache false global 2024-09-16T11:18:58.514 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global rm client.123 rbd_cache 2024-09-16T11:18:58.561 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config global rm global rbd_cache 2024-09-16T11:18:58.610 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool set rbd rbd_cache true 2024-09-16T11:18:58.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool list rbd 2024-09-16T11:18:58.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-16T11:18:58.705 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true pool 2024-09-16T11:18:58.705 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool get rbd rbd_cache 2024-09-16T11:18:58.705 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^true$' 2024-09-16T11:18:58.746 INFO:tasks.workunit.client.0.smithi137.stdout:true 2024-09-16T11:18:58.746 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 1 test1 2024-09-16T11:18:58.784 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:18:58.777+0000 7f9fd13024c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:18:58.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image list rbd/test1 2024-09-16T11:18:58.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-16T11:18:58.861 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true pool 2024-09-16T11:18:58.861 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image set rbd/test1 rbd_cache false 2024-09-16T11:18:58.933 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * false * image *$' 2024-09-16T11:18:58.933 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image list rbd/test1 2024-09-16T11:18:58.993 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache false image 2024-09-16T11:18:58.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image get rbd/test1 rbd_cache 2024-09-16T11:18:58.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^false$' 2024-09-16T11:18:59.053 INFO:tasks.workunit.client.0.smithi137.stdout:false 2024-09-16T11:18:59.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image remove rbd/test1 rbd_cache 2024-09-16T11:18:59.119 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2024-09-16T11:18:59.120 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image get rbd/test1 rbd_cache 2024-09-16T11:18:59.171 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: rbd_cache is not set 2024-09-16T11:18:59.182 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:59.183 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config image list rbd/test1 2024-09-16T11:18:59.183 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * pool *$' 2024-09-16T11:18:59.245 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true pool 2024-09-16T11:18:59.246 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool remove rbd rbd_cache 2024-09-16T11:18:59.300 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2024-09-16T11:18:59.300 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool get rbd rbd_cache 2024-09-16T11:18:59.339 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: rbd_cache is not set 2024-09-16T11:18:59.345 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:18:59.345 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd config pool list rbd 2024-09-16T11:18:59.345 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^rbd_cache * true * config *$' 2024-09-16T11:18:59.385 INFO:tasks.workunit.client.0.smithi137.stdout:rbd_cache true config 2024-09-16T11:18:59.386 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:18:59.447 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:18:59.451 INFO:tasks.workunit.client.0.smithi137.stderr:+ RBD_CREATE_ARGS= 2024-09-16T11:18:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_others 2024-09-16T11:18:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing import, export, resize, and snapshots...' 2024-09-16T11:18:59.452 INFO:tasks.workunit.client.0.smithi137.stdout:testing import, export, resize, and snapshots... 2024-09-16T11:18:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2024-09-16T11:18:59.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:18:59.453 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:59.578 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:18:59.705 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.038 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.154 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.598 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.725 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.846 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:00.970 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.098 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.353 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.474 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.605 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.733 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.857 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:01.986 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:02.123 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-16T11:19:02.124 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2024-09-16T11:19:02.126 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records in 2024-09-16T11:19:02.126 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records out 2024-09-16T11:19:02.126 INFO:tasks.workunit.client.0.smithi137.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000158656 s, 6.5 MB/s 2024-09-16T11:19:02.126 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2024-09-16T11:19:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:10+0 records in 2024-09-16T11:19:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:10+0 records out 2024-09-16T11:19:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000213093 s, 48.1 MB/s 2024-09-16T11:19:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2024-09-16T11:19:02.129 INFO:tasks.workunit.client.0.smithi137.stderr:70+1 records in 2024-09-16T11:19:02.129 INFO:tasks.workunit.client.0.smithi137.stderr:70+1 records out 2024-09-16T11:19:02.130 INFO:tasks.workunit.client.0.smithi137.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000638141 s, 113 MB/s 2024-09-16T11:19:02.130 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2024-09-16T11:19:02.131 INFO:tasks.workunit.client.0.smithi137.stderr:138+1 records in 2024-09-16T11:19:02.132 INFO:tasks.workunit.client.0.smithi137.stderr:138+1 records out 2024-09-16T11:19:02.132 INFO:tasks.workunit.client.0.smithi137.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.000813774 s, 175 MB/s 2024-09-16T11:19:02.132 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2024-09-16T11:19:02.133 INFO:tasks.workunit.client.0.smithi137.stderr:74+1 records in 2024-09-16T11:19:02.133 INFO:tasks.workunit.client.0.smithi137.stderr:74+1 records out 2024-09-16T11:19:02.133 INFO:tasks.workunit.client.0.smithi137.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000481879 s, 158 MB/s 2024-09-16T11:19:02.133 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import /tmp/img1 testimg1 2024-09-16T11:19:02.177 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:02.169+0000 7f6a201394c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:02.279 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2024-09-16T11:19:02.285 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2024-09-16T11:19:02.331 INFO:tasks.workunit.client.0.smithi137.stderr: Resizing image: 100% complete...done. 2024-09-16T11:19:02.338 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img2 2024-09-16T11:19:02.667 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:02.673 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-16T11:19:03.318 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:19:03.326 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=128 2024-09-16T11:19:03.381 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2024-09-16T11:19:03.390 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:19:03.390 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2024-09-16T11:19:03.469 INFO:tasks.workunit.client.0.smithi137.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2024-09-16T11:19:03.476 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img3 2024-09-16T11:19:03.568 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:03.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:03.573 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:03.624 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:03.624 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:03.624 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:03.674 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:03.674 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2024-09-16T11:19:03.675 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2024-09-16T11:19:03.817 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:03.822 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2024-09-16T11:19:03.893 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:19:03.898 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --size=1 testimg-diff1 2024-09-16T11:19:03.930 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:03.925+0000 7f289a8fb4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:03.943 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2024-09-16T11:19:04.332 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-09-16T11:19:04.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2024-09-16T11:19:04.416 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2024-09-16T11:19:04.423 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:04.423 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:04.471 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:04.471 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:04.472 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:04.523 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:04.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff1 2024-09-16T11:19:04.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:04.574 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:04.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-16T11:19:04.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:04.625 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:04.625 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2024-09-16T11:19:04.759 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:04.763 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg1 testimg3 2024-09-16T11:19:04.882 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:04.886 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2024-09-16T11:19:05.016 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:05.019 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2024-09-16T11:19:05.253 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:05.249+0000 7f7289847700 0 --2- 172.21.15.137:0/3902785448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x556c0edfd830 0x556c0edf4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T11:19:05.354 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:05.360 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:05.360 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg2 2024-09-16T11:19:05.407 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:05.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:05.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:19:05.464 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:05.465 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff2 2024-09-16T11:19:05.465 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:05.521 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:05.521 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff3 2024-09-16T11:19:05.521 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:05.572 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:05.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy testimg1 testimg4 2024-09-16T11:19:06.390 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete...2024-09-16T11:19:06.385+0000 7f646ec32700 0 -- 172.21.15.137:0/3517228264 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x558bd6b142e0 msgr2=0x558bd6c082d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:06.407 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-16T11:19:06.412 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2024-09-16T11:19:07.399 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2024-09-16T11:19:07.393+0000 7f4b91bec700 0 -- 172.21.15.137:0/280553669 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f4b6c001be0 msgr2=0x7f4b6c004090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:19:07.401 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 100% complete...done. 2024-09-16T11:19:07.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg4 2024-09-16T11:19:07.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:07.454 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:07.454 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg5 2024-09-16T11:19:07.454 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:07.509 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:07.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg4 2024-09-16T11:19:07.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:19:07.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:07.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:19:07.571 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:19:07.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg4 2024-09-16T11:19:07.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '.*snap1.*' 2024-09-16T11:19:07.631 INFO:tasks.workunit.client.0.smithi137.stdout: 18 snap1 256 MiB Mon Sep 16 11:19:06 2024 2024-09-16T11:19:07.631 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img1.new 2024-09-16T11:19:07.726 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:07.730 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg2 /tmp/img2.new 2024-09-16T11:19:07.868 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:07.872 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg3 /tmp/img3.new 2024-09-16T11:19:07.970 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:07.974 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2024-09-16T11:19:08.072 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:08.076 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2024-09-16T11:19:08.221 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:08.226 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2024-09-16T11:19:08.326 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:08.330 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img2.new 2024-09-16T11:19:08.557 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img3 /tmp/img3.new 2024-09-16T11:19:08.675 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2024-09-16T11:19:08.886 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2024-09-16T11:19:08.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rollback --snap=snap1 testimg1 2024-09-16T11:19:09.110 INFO:tasks.workunit.client.0.smithi137.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-16T11:19:09.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2024-09-16T11:19:09.240 INFO:tasks.workunit.client.0.smithi137.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-16T11:19:09.252 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:09.252 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:09.297 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:09.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff1 2024-09-16T11:19:09.297 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:09.348 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:09.349 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img1.snap1 2024-09-16T11:19:09.487 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:09.491 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2024-09-16T11:19:09.618 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:09.622 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2024-09-16T11:19:09.812 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2024-09-16T11:19:10.002 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg2 2024-09-16T11:19:10.145 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete...2024-09-16T11:19:10.137+0000 7f2ba3311700 0 -- 172.21.15.137:0/1228704808 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x557d23996600 msgr2=0x557d23a39810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:10.177 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-16T11:19:10.169+0000 7f2ba2b10700 0 -- 172.21.15.137:0/1228704808 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x557d23ad1ce0 msgr2=0x557d23a82960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:10.178 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:19:10.182 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg3 2024-09-16T11:19:10.351 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2024-09-16T11:19:10.355 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create testimg2 -s 0 2024-09-16T11:19:10.398 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:10.393+0000 7f8b0859d4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:10.411 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd cp testimg2 testimg3 2024-09-16T11:19:10.496 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete...done. 2024-09-16T11:19:10.500 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep cp testimg2 testimg6 2024-09-16T11:19:10.595 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 100% complete...done. 2024-09-16T11:19:10.601 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm --snap=snap1 testimg1 2024-09-16T11:19:11.406 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:19:11.414 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2024-09-16T11:19:12.422 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:19:12.429 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:12.429 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-16T11:19:12.474 INFO:tasks.workunit.client.0.smithi137.stdout:error setting snapshot context: (2) No such file or directory 2024-09-16T11:19:12.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-16T11:19:12.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-16T11:19:12.523 INFO:tasks.workunit.client.0.smithi137.stdout:error setting snapshot context: (2) No such file or directory 2024-09-16T11:19:12.523 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd sparsify testimg1 2024-09-16T11:19:12.689 INFO:tasks.workunit.client.0.smithi137.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2024-09-16T11:19:12.699 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:12.699 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:12.850 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:13.182 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:13.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:14.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:15.626 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:15.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.012 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.242 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.469 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.585 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.712 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.841 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:16.966 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.099 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.222 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.346 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.481 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.605 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-16T11:19:17.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_locking 2024-09-16T11:19:17.710 INFO:tasks.workunit.client.0.smithi137.stdout:testing locking... 2024-09-16T11:19:17.711 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing locking...' 2024-09-16T11:19:17.711 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:17.711 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.843 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:17.979 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.109 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.234 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.365 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.494 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.624 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.752 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:18.880 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.006 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.136 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.262 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.656 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.786 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:19.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:20.043 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create -s 1 test1 2024-09-16T11:19:20.087 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:20.081+0000 7f208bcc44c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:20.101 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:20.101 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:20.101 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:20.152 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:20.152 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id 2024-09-16T11:19:20.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:20.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 1 ' 2024-09-16T11:19:20.264 INFO:tasks.workunit.client.0.smithi137.stdout:There is 1 exclusive lock on this image. 2024-09-16T11:19:20.265 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd lock list test1 2024-09-16T11:19:20.265 INFO:tasks.workunit.client.0.smithi137.stderr:++ tail -n 1 2024-09-16T11:19:20.266 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{print $1;}' 2024-09-16T11:19:20.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ LOCKER=client.7779 2024-09-16T11:19:20.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock remove test1 id client.7779 2024-09-16T11:19:20.701 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:20.701 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:20.701 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:20.752 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:20.752 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id --shared tag 2024-09-16T11:19:21.028 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:21.028 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 1 ' 2024-09-16T11:19:21.077 INFO:tasks.workunit.client.0.smithi137.stdout:There is 1 shared lock on this image. 2024-09-16T11:19:21.078 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id --shared tag 2024-09-16T11:19:21.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:21.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 2 ' 2024-09-16T11:19:21.193 INFO:tasks.workunit.client.0.smithi137.stdout:There are 2 shared locks on this image. 2024-09-16T11:19:21.194 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id2 --shared tag 2024-09-16T11:19:21.261 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:21.261 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 3 ' 2024-09-16T11:19:21.312 INFO:tasks.workunit.client.0.smithi137.stdout:There are 3 shared locks on this image. 2024-09-16T11:19:21.313 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:21.313 INFO:tasks.workunit.client.0.smithi137.stderr:+ tail -n 1 2024-09-16T11:19:21.313 INFO:tasks.workunit.client.0.smithi137.stderr:+ awk '{print $2, $1;}' 2024-09-16T11:19:21.313 INFO:tasks.workunit.client.0.smithi137.stderr:+ xargs rbd lock remove test1 2024-09-16T11:19:21.700 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:19:21.701 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -qE 'features:.*exclusive' 2024-09-16T11:19:21.965 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:19:22.028 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:19:22.033 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_thick_provision 2024-09-16T11:19:22.033 INFO:tasks.workunit.client.0.smithi137.stdout:testing thick provision... 2024-09-16T11:19:22.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing thick provision...' 2024-09-16T11:19:22.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:22.034 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:22.369 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:22.501 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:22.629 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:22.751 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:22.885 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.017 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.150 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.285 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.417 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.550 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.682 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.808 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:23.935 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:24.065 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:24.185 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:24.313 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:24.449 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:24.586 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --thick-provision -s 64M test1 2024-09-16T11:19:24.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:24.621+0000 7f001ea924c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:24.933 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-16T11:19:24.951 INFO:tasks.workunit.client.0.smithi137.stderr:+ count=0 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret= 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 -lt 10 ']' 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr -s ' ' 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ cut -d ' ' -f 4-5 2024-09-16T11:19:24.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^64 MiB' 2024-09-16T11:19:24.985 INFO:tasks.workunit.client.0.smithi137.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-16T11:19:24.993 INFO:tasks.workunit.client.0.smithi137.stdout:64 MiB 2024-09-16T11:19:24.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret=0 2024-09-16T11:19:24.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 = 0 ']' 2024-09-16T11:19:24.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ break 2024-09-16T11:19:24.994 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:19:25.035 INFO:tasks.workunit.client.0.smithi137.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-16T11:19:25.039 INFO:tasks.workunit.client.0.smithi137.stdout:NAME PROVISIONED USED 2024-09-16T11:19:25.039 INFO:tasks.workunit.client.0.smithi137.stdout:test1 64 MiB 64 MiB 2024-09-16T11:19:25.044 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 '!=' 0 ']' 2024-09-16T11:19:25.044 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:19:25.139 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2024-09-16T11:19:25.142 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:19:25.142 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:19:25.142 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:25.143 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:25.180 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:25.180 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --thick-provision -s 4G test1 2024-09-16T11:19:25.217 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:25.213+0000 7f7db67194c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:26.214 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete...2024-09-16T11:19:26.209+0000 7f7db4a4e700 0 -- 172.21.15.137:0/1941026016 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x557a671ed050 msgr2=0x557a671ef430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:26.421 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 11% complete... Thick provisioning: 12% complete...2024-09-16T11:19:26.421+0000 7f7db4a4e700 0 -- 172.21.15.137:0/1941026016 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f7d9403a7f0 msgr2=0x7f7d9403cc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:35.280 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-16T11:19:35.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ count=0 2024-09-16T11:19:35.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret= 2024-09-16T11:19:35.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 -lt 10 ']' 2024-09-16T11:19:35.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:19:35.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:19:35.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr -s ' ' 2024-09-16T11:19:35.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ cut -d ' ' -f 4-5 2024-09-16T11:19:35.289 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^4 GiB' 2024-09-16T11:19:35.329 INFO:tasks.workunit.client.0.smithi137.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-16T11:19:35.348 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:35.344+0000 7fd05b23c700 0 -- 172.21.15.137:0/1982700780 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x559f647ec3f0 msgr2=0x559f647ee7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:19:35.351 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:35.348+0000 7fd05b23c700 0 -- 172.21.15.137:0/1982700780 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fd04003a8c0 msgr2=0x7fd04003cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:35.575 INFO:tasks.workunit.client.0.smithi137.stdout:4 GiB 2024-09-16T11:19:35.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret=0 2024-09-16T11:19:35.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 = 0 ']' 2024-09-16T11:19:35.576 INFO:tasks.workunit.client.0.smithi137.stderr:+ break 2024-09-16T11:19:35.576 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:19:35.611 INFO:tasks.workunit.client.0.smithi137.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2024-09-16T11:19:35.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:35.624+0000 7fba2de75700 0 -- 172.21.15.137:0/4124829281 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55f459e0e830 msgr2=0x55f459e9d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:35.631 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:35.628+0000 7fba2d674700 0 -- 172.21.15.137:0/4124829281 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55f459ebc530 msgr2=0x55f459ebe910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:19:35.775 INFO:tasks.workunit.client.0.smithi137.stdout:NAME PROVISIONED USED 2024-09-16T11:19:35.776 INFO:tasks.workunit.client.0.smithi137.stdout:test1 4 GiB 4 GiB 2024-09-16T11:19:35.778 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 '!=' 0 ']' 2024-09-16T11:19:35.778 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:19:35.909 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete...2024-09-16T11:19:35.904+0000 7fdce49a0700 0 -- 172.21.15.137:0/4216013395 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5646c2d007a0 msgr2=0x5646c2d02b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:35.926 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 11% complete... Removing image: 12% complete...2024-09-16T11:19:35.924+0000 7fdce51a1700 0 -- 172.21.15.137:0/4216013395 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5646c2c58810 msgr2=0x5646c2cff9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:36.758 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-16T11:19:36.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:19:36.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:19:36.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:36.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:36.796 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:36.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2024-09-16T11:19:36.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_others 2024-09-16T11:19:36.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing import, export, resize, and snapshots...' 2024-09-16T11:19:36.797 INFO:tasks.workunit.client.0.smithi137.stdout:testing import, export, resize, and snapshots... 2024-09-16T11:19:36.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2024-09-16T11:19:36.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:36.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:36.911 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.169 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.304 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.425 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.555 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.686 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.822 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:37.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.094 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.229 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.363 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.498 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.624 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:38.896 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:39.028 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:39.152 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-16T11:19:39.153 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2024-09-16T11:19:39.154 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records in 2024-09-16T11:19:39.155 INFO:tasks.workunit.client.0.smithi137.stderr:1+0 records out 2024-09-16T11:19:39.155 INFO:tasks.workunit.client.0.smithi137.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00017295 s, 5.9 MB/s 2024-09-16T11:19:39.155 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2024-09-16T11:19:39.156 INFO:tasks.workunit.client.0.smithi137.stderr:10+0 records in 2024-09-16T11:19:39.156 INFO:tasks.workunit.client.0.smithi137.stderr:10+0 records out 2024-09-16T11:19:39.157 INFO:tasks.workunit.client.0.smithi137.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.00018379 s, 55.7 MB/s 2024-09-16T11:19:39.157 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2024-09-16T11:19:39.158 INFO:tasks.workunit.client.0.smithi137.stderr:70+1 records in 2024-09-16T11:19:39.158 INFO:tasks.workunit.client.0.smithi137.stderr:70+1 records out 2024-09-16T11:19:39.159 INFO:tasks.workunit.client.0.smithi137.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000573322 s, 126 MB/s 2024-09-16T11:19:39.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2024-09-16T11:19:39.161 INFO:tasks.workunit.client.0.smithi137.stderr:138+1 records in 2024-09-16T11:19:39.161 INFO:tasks.workunit.client.0.smithi137.stderr:138+1 records out 2024-09-16T11:19:39.161 INFO:tasks.workunit.client.0.smithi137.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.000985886 s, 144 MB/s 2024-09-16T11:19:39.161 INFO:tasks.workunit.client.0.smithi137.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2024-09-16T11:19:39.163 INFO:tasks.workunit.client.0.smithi137.stderr:74+1 records in 2024-09-16T11:19:39.163 INFO:tasks.workunit.client.0.smithi137.stderr:74+1 records out 2024-09-16T11:19:39.163 INFO:tasks.workunit.client.0.smithi137.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000620294 s, 123 MB/s 2024-09-16T11:19:39.163 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2024-09-16T11:19:39.349 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2024-09-16T11:19:39.353 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2024-09-16T11:19:39.426 INFO:tasks.workunit.client.0.smithi137.stderr: Resizing image: 100% complete...done. 2024-09-16T11:19:39.440 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img2 2024-09-16T11:19:39.585 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:39.589 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-16T11:19:39.849 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:19:39.865 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=128 2024-09-16T11:19:39.925 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2024-09-16T11:19:39.934 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:19:39.935 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2024-09-16T11:19:40.011 INFO:tasks.workunit.client.0.smithi137.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2024-09-16T11:19:40.026 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img3 2024-09-16T11:19:40.135 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:40.140 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:40.140 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:40.201 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:40.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:40.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:40.260 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:40.260 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2024-09-16T11:19:40.262 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2024-09-16T11:19:40.366 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:40.371 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2024-09-16T11:19:40.427 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 100% complete...done. 2024-09-16T11:19:40.430 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2024-09-16T11:19:40.490 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2024-09-16T11:19:40.854 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2024-09-16T11:19:40.869 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2024-09-16T11:19:40.945 INFO:tasks.workunit.client.0.smithi137.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2024-09-16T11:19:40.959 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:40.959 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:41.015 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:41.016 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:41.016 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:41.082 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff1 2024-09-16T11:19:41.083 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:41.141 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:41.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-16T11:19:41.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:41.203 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:41.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2024-09-16T11:19:41.361 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:41.365 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg1 testimg3 2024-09-16T11:19:41.513 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:41.518 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2024-09-16T11:19:41.674 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:41.679 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2024-09-16T11:19:41.832 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-16T11:19:41.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg2 2024-09-16T11:19:41.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:41.890 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:41.890 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:19:41.891 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:41.946 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:41.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff2 2024-09-16T11:19:41.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:42.003 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:42.004 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff3 2024-09-16T11:19:42.004 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:42.060 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:42.060 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy testimg1 testimg4 2024-09-16T11:19:42.918 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-16T11:19:42.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2024-09-16T11:19:43.925 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-16T11:19:43.930 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg4 2024-09-16T11:19:43.930 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 128 MiB' 2024-09-16T11:19:43.985 INFO:tasks.workunit.client.0.smithi137.stdout: size 128 MiB in 32 objects 2024-09-16T11:19:43.986 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg5 2024-09-16T11:19:43.986 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:44.045 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:44.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg4 2024-09-16T11:19:44.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:19:44.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:44.047 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:19:44.102 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:19:44.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg4 2024-09-16T11:19:44.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '.*snap1.*' 2024-09-16T11:19:44.158 INFO:tasks.workunit.client.0.smithi137.stdout: 26 snap1 256 MiB Mon Sep 16 11:19:42 2024 2024-09-16T11:19:44.159 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img1.new 2024-09-16T11:19:44.264 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.267 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg2 /tmp/img2.new 2024-09-16T11:19:44.401 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.405 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg3 /tmp/img3.new 2024-09-16T11:19:44.504 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.508 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2024-09-16T11:19:44.613 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.617 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2024-09-16T11:19:44.749 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.754 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2024-09-16T11:19:44.856 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:44.860 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img2.new 2024-09-16T11:19:45.086 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img3 /tmp/img3.new 2024-09-16T11:19:45.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2024-09-16T11:19:45.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2024-09-16T11:19:45.509 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rollback --snap=snap1 testimg1 2024-09-16T11:19:45.669 INFO:tasks.workunit.client.0.smithi137.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-16T11:19:45.684 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2024-09-16T11:19:45.842 INFO:tasks.workunit.client.0.smithi137.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2024-09-16T11:19:45.851 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:45.851 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg1 2024-09-16T11:19:45.907 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:45.907 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg-diff1 2024-09-16T11:19:45.907 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:19:45.967 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:19:45.968 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg1 /tmp/img1.snap1 2024-09-16T11:19:46.098 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:46.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2024-09-16T11:19:46.233 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-16T11:19:46.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2024-09-16T11:19:46.426 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2024-09-16T11:19:46.619 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg2 2024-09-16T11:19:46.814 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-16T11:19:46.812+0000 7efc7d553700 0 -- 172.21.15.137:0/2318952554 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556213c1ba00 msgr2=0x556213cc07c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:46.834 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:19:46.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg3 2024-09-16T11:19:47.029 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-16T11:19:47.028+0000 7f0e24bb6700 0 -- 172.21.15.137:0/4092769473 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0dfc008980 msgr2=0x7f0dfc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:19:47.054 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:19:47.058 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create testimg2 -s 0 2024-09-16T11:19:47.100 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:19:47.096+0000 7fb3b413c4c0 -1 librbd: Forced V1 image creation. 2024-09-16T11:19:47.114 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd cp testimg2 testimg3 2024-09-16T11:19:47.199 INFO:tasks.workunit.client.0.smithi137.stderr: Image copy: 100% complete...done. 2024-09-16T11:19:47.204 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep cp testimg2 testimg6 2024-09-16T11:19:47.297 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 100% complete...done. 2024-09-16T11:19:47.302 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm --snap=snap1 testimg1 2024-09-16T11:19:47.876 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:19:47.893 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2024-09-16T11:19:48.877 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:19:48.900 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg1 2024-09-16T11:19:48.900 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-16T11:19:48.952 INFO:tasks.workunit.client.0.smithi137.stdout:error setting snapshot context: (2) No such file or directory 2024-09-16T11:19:48.953 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2024-09-16T11:19:48.953 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --snap=snap1 testimg-diff1 2024-09-16T11:19:49.004 INFO:tasks.workunit.client.0.smithi137.stdout:error setting snapshot context: (2) No such file or directory 2024-09-16T11:19:49.004 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd sparsify testimg1 2024-09-16T11:19:49.093 INFO:tasks.workunit.client.0.smithi137.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2024-09-16T11:19:49.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:49.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:49.386 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:49.513 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:49.732 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:50.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:51.123 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:51.353 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:51.659 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:51.954 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.233 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.371 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.511 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.774 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:52.911 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:53.248 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:53.380 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:53.512 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:53.642 INFO:tasks.workunit.client.0.smithi137.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2024-09-16T11:19:53.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_locking 2024-09-16T11:19:53.748 INFO:tasks.workunit.client.0.smithi137.stdout:testing locking... 2024-09-16T11:19:53.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing locking...' 2024-09-16T11:19:53.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:19:53.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:53.877 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.007 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.135 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.269 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.403 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.529 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.663 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:54.922 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.059 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.195 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.329 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.464 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.740 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:55.873 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:56.006 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:19:56.141 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:19:56.212 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:56.212 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:56.212 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:56.270 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:56.270 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id 2024-09-16T11:19:56.340 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:56.340 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 1 ' 2024-09-16T11:19:56.398 INFO:tasks.workunit.client.0.smithi137.stdout:There is 1 exclusive lock on this image. 2024-09-16T11:19:56.400 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd lock list test1 2024-09-16T11:19:56.400 INFO:tasks.workunit.client.0.smithi137.stderr:++ tail -n 1 2024-09-16T11:19:56.400 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{print $1;}' 2024-09-16T11:19:56.456 INFO:tasks.workunit.client.0.smithi137.stderr:+ LOCKER=client.8452 2024-09-16T11:19:56.456 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock remove test1 id client.8452 2024-09-16T11:19:57.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:57.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:19:57.394 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:19:57.446 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:19:57.446 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id --shared tag 2024-09-16T11:19:57.523 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:57.523 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 1 ' 2024-09-16T11:19:57.580 INFO:tasks.workunit.client.0.smithi137.stdout:There is 1 shared lock on this image. 2024-09-16T11:19:57.580 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id --shared tag 2024-09-16T11:19:57.654 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:57.654 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 2 ' 2024-09-16T11:19:57.710 INFO:tasks.workunit.client.0.smithi137.stdout:There are 2 shared locks on this image. 2024-09-16T11:19:57.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock add test1 id2 --shared tag 2024-09-16T11:19:57.783 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:57.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep ' 3 ' 2024-09-16T11:19:57.839 INFO:tasks.workunit.client.0.smithi137.stdout:There are 3 shared locks on this image. 2024-09-16T11:19:57.840 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:57.840 INFO:tasks.workunit.client.0.smithi137.stderr:+ tail -n 1 2024-09-16T11:19:57.840 INFO:tasks.workunit.client.0.smithi137.stderr:+ awk '{print $2, $1;}' 2024-09-16T11:19:57.841 INFO:tasks.workunit.client.0.smithi137.stderr:+ xargs rbd lock remove test1 2024-09-16T11:19:58.397 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info test1 2024-09-16T11:19:58.398 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -qE 'features:.*exclusive' 2024-09-16T11:19:58.459 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd lock list test1 2024-09-16T11:19:58.513 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n 'There are 2 shared locks on this image. 2024-09-16T11:19:58.513 INFO:tasks.workunit.client.0.smithi137.stderr:Lock tag: tag 2024-09-16T11:19:58.513 INFO:tasks.workunit.client.0.smithi137.stderr:Locker ID Address 2024-09-16T11:19:58.514 INFO:tasks.workunit.client.0.smithi137.stderr:client.8467 id 172.21.15.137:0/2213081208 2024-09-16T11:19:58.514 INFO:tasks.workunit.client.0.smithi137.stderr:client.8473 id 172.21.15.137:0/2415979946' ']' 2024-09-16T11:19:58.514 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:58.514 INFO:tasks.workunit.client.0.smithi137.stderr:+ tail -n 1 2024-09-16T11:19:58.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ awk '{print $2, $1;}' 2024-09-16T11:19:58.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ xargs rbd lock remove test1 2024-09-16T11:19:59.406 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd lock list test1 2024-09-16T11:19:59.461 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n 'There is 1 shared lock on this image. 2024-09-16T11:19:59.461 INFO:tasks.workunit.client.0.smithi137.stderr:Lock tag: tag 2024-09-16T11:19:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:Locker ID Address 2024-09-16T11:19:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:client.8467 id 172.21.15.137:0/2213081208' ']' 2024-09-16T11:19:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd lock list test1 2024-09-16T11:19:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ tail -n 1 2024-09-16T11:19:59.462 INFO:tasks.workunit.client.0.smithi137.stderr:+ awk '{print $2, $1;}' 2024-09-16T11:19:59.463 INFO:tasks.workunit.client.0.smithi137.stderr:+ xargs rbd lock remove test1 2024-09-16T11:20:00.410 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd lock list test1 2024-09-16T11:20:00.459 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' -n '' ']' 2024-09-16T11:20:00.460 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:20:00.628 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:00.624+0000 7fea183d0700 0 -- 172.21.15.137:0/1499279726 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a281260600 msgr2=0x55a2813039e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:00.651 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:00.656 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_clone 2024-09-16T11:20:00.657 INFO:tasks.workunit.client.0.smithi137.stdout:testing clone... 2024-09-16T11:20:00.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing clone...' 2024-09-16T11:20:00.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:20:00.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:00.792 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:00.923 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.059 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.195 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.466 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.601 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.731 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.857 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:01.989 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.127 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.256 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.388 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.518 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.775 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:02.910 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:03.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create test1 --image-format 2 -s 1 2024-09-16T11:20:03.122 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@s1 2024-09-16T11:20:03.425 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:03.440 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect test1@s1 2024-09-16T11:20:03.516 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool create rbd2 8 2024-09-16T11:20:04.530 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' already exists 2024-09-16T11:20:04.538 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd pool init rbd2 2024-09-16T11:20:07.447 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@s1 rbd2/clone 2024-09-16T11:20:07.549 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls 2024-09-16T11:20:07.549 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone 2024-09-16T11:20:07.593 INFO:tasks.workunit.client.0.smithi137.stdout:clone 2024-09-16T11:20:07.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls -l 2024-09-16T11:20:07.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone 2024-09-16T11:20:07.594 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1@s1 2024-09-16T11:20:07.671 INFO:tasks.workunit.client.0.smithi137.stdout:clone 1 MiB rbd/test1@s1 2 2024-09-16T11:20:07.671 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:07.672 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v clone 2024-09-16T11:20:07.716 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:20:07.716 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd flatten rbd2/clone 2024-09-16T11:20:07.796 INFO:tasks.workunit.client.0.smithi137.stderr: Image flatten: 100% complete...done. 2024-09-16T11:20:07.809 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create rbd2/clone@s1 2024-09-16T11:20:08.456 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:08.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect rbd2/clone@s1 2024-09-16T11:20:08.533 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone rbd2/clone@s1 clone2 2024-09-16T11:20:08.649 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:08.649 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone2 2024-09-16T11:20:08.686 INFO:tasks.workunit.client.0.smithi137.stdout:clone2 2024-09-16T11:20:08.687 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:20:08.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone2 2024-09-16T11:20:08.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep rbd2/clone@s1 2024-09-16T11:20:08.749 INFO:tasks.workunit.client.0.smithi137.stdout:clone2 1 MiB rbd2/clone@s1 2 2024-09-16T11:20:08.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd -p rbd2 ls 2024-09-16T11:20:08.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v clone2 2024-09-16T11:20:08.790 INFO:tasks.workunit.client.0.smithi137.stdout:clone 2024-09-16T11:20:08.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm clone2 2024-09-16T11:20:09.008 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:09.004+0000 7fd1cb7c2700 0 -- 172.21.15.137:0/248969717 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5646219887e0 msgr2=0x56462198bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:09.009 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:09.014 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect rbd2/clone@s1 2024-09-16T11:20:09.079 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm rbd2/clone@s1 2024-09-16T11:20:09.452 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:09.469 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm rbd2/clone 2024-09-16T11:20:09.607 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:09.604+0000 7fd3866c0700 0 -- 172.21.15.137:0/243566461 >> [v2:172.21.15.137:6816/20977,v1:172.21.15.137:6817/20977] conn(0x559a960ca2e0 msgr2=0x559a960cc760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:09.617 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:09.622 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect test1@s1 2024-09-16T11:20:09.701 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm test1@s1 2024-09-16T11:20:10.463 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:10.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:20:10.686 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:10.684+0000 7f26f8604700 0 -- 172.21.15.137:0/3103576128 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f26dc008980 msgr2=0x7f26dc00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:20:10.687 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:10.692 INFO:tasks.workunit.client.0.smithi137.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2024-09-16T11:20:11.565 INFO:tasks.workunit.client.0.smithi137.stderr:pool 'rbd2' does not exist 2024-09-16T11:20:11.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_trash 2024-09-16T11:20:11.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing trash...' 2024-09-16T11:20:11.574 INFO:tasks.workunit.client.0.smithi137.stdout:testing trash... 2024-09-16T11:20:11.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:20:11.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:11.703 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:11.837 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:11.968 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.229 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.367 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.495 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.633 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.764 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:12.902 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.039 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.311 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.445 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.575 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.712 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.846 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:13.978 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:20:14.051 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test2 2024-09-16T11:20:14.122 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:14.122 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:20:14.164 INFO:tasks.workunit.client.0.smithi137.stdout:test1 2024-09-16T11:20:14.164 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:14.164 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:20:14.207 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:20:14.207 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:14.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:14.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:14.246 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:14.247 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:20:14.247 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*2.*' 2024-09-16T11:20:14.304 INFO:tasks.workunit.client.0.smithi137.stdout:test1 1 MiB 2 2024-09-16T11:20:14.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:20:14.305 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*2.*' 2024-09-16T11:20:14.360 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 2 2024-09-16T11:20:14.360 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv test1 2024-09-16T11:20:14.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:14.469 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:20:14.504 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:20:14.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:14.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:14.505 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:14.546 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:14.546 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:20:14.547 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*2.*' 2024-09-16T11:20:14.598 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 2 2024-09-16T11:20:14.599 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:14.599 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:20:14.643 INFO:tasks.workunit.client.0.smithi137.stdout:2265f4829d6e test1 2024-09-16T11:20:14.643 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:14.644 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:14.644 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:14.683 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:14.684 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:14.685 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*USER.*' 2024-09-16T11:20:14.735 INFO:tasks.workunit.client.0.smithi137.stdout:2265f4829d6e test1 USER Mon Sep 16 11:20:14 2024 expired at Mon Sep 16 11:20:14 2024 2024-09-16T11:20:14.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:14.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v 'protected until' 2024-09-16T11:20:14.797 INFO:tasks.workunit.client.0.smithi137.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2024-09-16T11:20:14.798 INFO:tasks.workunit.client.0.smithi137.stdout:2265f4829d6e test1 USER Mon Sep 16 11:20:14 2024 expired at Mon Sep 16 11:20:14 2024 2024-09-16T11:20:14.798 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:14.799 INFO:tasks.workunit.client.0.smithi137.stderr:++ cut -d ' ' -f 1 2024-09-16T11:20:14.844 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=2265f4829d6e 2024-09-16T11:20:14.844 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm 2265f4829d6e 2024-09-16T11:20:14.958 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:14.961 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv test2 2024-09-16T11:20:15.075 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:15.075 INFO:tasks.workunit.client.0.smithi137.stderr:++ cut -d ' ' -f 1 2024-09-16T11:20:15.120 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=22681114041b 2024-09-16T11:20:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info --image-id 22681114041b 2024-09-16T11:20:15.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'rbd image '\''test2'\''' 2024-09-16T11:20:15.175 INFO:tasks.workunit.client.0.smithi137.stdout:rbd image 'test2': 2024-09-16T11:20:15.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd children --image-id 22681114041b 2024-09-16T11:20:15.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:15.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:15.232 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:15.233 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash restore 22681114041b 2024-09-16T11:20:15.295 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:15.296 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:20:15.338 INFO:tasks.workunit.client.0.smithi137.stdout:test2 2024-09-16T11:20:15.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:20:15.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:15.339 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:15.380 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:15.381 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*2.*' 2024-09-16T11:20:15.381 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls -l 2024-09-16T11:20:15.438 INFO:tasks.workunit.client.0.smithi137.stdout:test2 1 MiB 2 2024-09-16T11:20:15.438 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2024-09-16T11:20:15.542 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image test2 will expire at 2024-09-16T12:20:15.477179+0000 2024-09-16T11:20:15.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:15.548 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test2 2024-09-16T11:20:15.586 INFO:tasks.workunit.client.0.smithi137.stdout:22681114041b test2 2024-09-16T11:20:15.586 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:15.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:15.587 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:15.829 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:15.830 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:15.830 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test2.*USER.*protected until' 2024-09-16T11:20:15.885 INFO:tasks.workunit.client.0.smithi137.stdout:22681114041b test2 USER Mon Sep 16 11:20:15 2024 protected until Mon Sep 16 12:20:15 2024 2024-09-16T11:20:15.886 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm 22681114041b 2024-09-16T11:20:15.886 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'Deferment time has not expired' 2024-09-16T11:20:15.930 INFO:tasks.workunit.client.0.smithi137.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2024-09-16T11:20:15.930 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm --image-id 22681114041b --force 2024-09-16T11:20:16.042 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:16.046 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:20:16.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@snap1 2024-09-16T11:20:16.718 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:16.733 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect test1@snap1 2024-09-16T11:20:16.806 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@snap1 clone 2024-09-16T11:20:16.922 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv test1 2024-09-16T11:20:17.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:17.020 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:20:17.059 INFO:tasks.workunit.client.0.smithi137.stdout:22c2647f233f test1 2024-09-16T11:20:17.059 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:17.060 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:17.060 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:17.103 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:17.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:17.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*USER.*' 2024-09-16T11:20:17.157 INFO:tasks.workunit.client.0.smithi137.stdout:22c2647f233f test1 USER Mon Sep 16 11:20:17 2024 expired at Mon Sep 16 11:20:17 2024 2024-09-16T11:20:17.158 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:17.158 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v 'protected until' 2024-09-16T11:20:17.423 INFO:tasks.workunit.client.0.smithi137.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2024-09-16T11:20:17.423 INFO:tasks.workunit.client.0.smithi137.stdout:22c2647f233f test1 USER Mon Sep 16 11:20:17 2024 expired at Mon Sep 16 11:20:17 2024 2024-09-16T11:20:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:17.425 INFO:tasks.workunit.client.0.smithi137.stderr:++ cut -d ' ' -f 1 2024-09-16T11:20:17.467 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=22c2647f233f 2024-09-16T11:20:17.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:20:17.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:17.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls --image-id 22c2647f233f 2024-09-16T11:20:17.468 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:17.523 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:17.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls --image-id 22c2647f233f 2024-09-16T11:20:17.524 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '.*snap1.*' 2024-09-16T11:20:17.580 INFO:tasks.workunit.client.0.smithi137.stdout: 34 snap1 1 MiB yes Mon Sep 16 11:20:16 2024 2024-09-16T11:20:17.581 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd children --image-id 22c2647f233f 2024-09-16T11:20:17.581 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:17.581 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:17.653 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:17.653 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd children --image-id 22c2647f233f 2024-09-16T11:20:17.653 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep clone 2024-09-16T11:20:17.731 INFO:tasks.workunit.client.0.smithi137.stdout:rbd/clone 2024-09-16T11:20:17.731 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm clone 2024-09-16T11:20:17.904 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:17.899+0000 7f58579af700 0 -- 172.21.15.137:0/3313040187 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f583c008980 msgr2=0x7f583c00ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:17.923 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:17.928 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect --image-id 22c2647f233f --snap snap1 2024-09-16T11:20:18.004 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm --image-id 22c2647f233f --snap snap1 2024-09-16T11:20:18.709 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:18.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls --image-id 22c2647f233f 2024-09-16T11:20:18.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:20:18.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:18.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:18.788 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:18.789 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash restore 22c2647f233f 2024-09-16T11:20:18.849 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@snap1 2024-09-16T11:20:19.721 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:19.737 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@snap2 2024-09-16T11:20:20.723 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:20.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls --image-id 22c2647f233f 2024-09-16T11:20:20.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:20:20.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:20.739 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:20.797 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:20.797 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 22c2647f233f 2024-09-16T11:20:22.731 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:20:22.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls --image-id 22c2647f233f 2024-09-16T11:20:22.748 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:20:22.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:22.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:22.804 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:22.804 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2024-09-16T11:20:22.903 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:22.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:22.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:20:22.946 INFO:tasks.workunit.client.0.smithi137.stdout:22c2647f233f test1 2024-09-16T11:20:22.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:22.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:22.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:22.987 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:22.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -l 2024-09-16T11:20:22.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'test1.*USER.*protected until' 2024-09-16T11:20:23.046 INFO:tasks.workunit.client.0.smithi137.stdout:22c2647f233f test1 USER Mon Sep 16 11:20:22 2024 protected until Mon Sep 16 12:20:22 2024 2024-09-16T11:20:23.048 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm 22c2647f233f 2024-09-16T11:20:23.048 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'Deferment time has not expired' 2024-09-16T11:20:23.088 INFO:tasks.workunit.client.0.smithi137.stdout:Deferment time has not expired, please use --force if you 2024-09-16T11:20:23.079+0000 7f9b48bb74c0 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2024-09-16T11:20:23.089 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash rm --image-id 22c2647f233f --force 2024-09-16T11:20:23.198 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:23.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:20:23.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.338 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.473 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.608 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.735 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.864 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:23.995 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.128 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.250 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.383 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.645 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.774 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:24.914 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.045 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.175 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.518 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.654 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_purge 2024-09-16T11:20:25.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing trash purge...' 2024-09-16T11:20:25.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:20:25.790 INFO:tasks.workunit.client.0.smithi137.stdout:testing trash purge... 2024-09-16T11:20:25.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:25.920 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.052 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.183 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.323 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.454 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.584 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.726 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.860 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:26.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.117 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.248 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.381 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.511 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.642 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.771 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:27.903 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:28.036 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:20:28.180 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:28.180 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:28.180 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:28.223 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:28.223 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:28.260 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete...done. 2024-09-16T11:20:28.263 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:28.340 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-16T11:20:28.406 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:28.504 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:28.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:28.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:28.616 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:28.660 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:28.660 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:28.827 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:28.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:28.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:28.832 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:28.872 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:28.873 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:28.939 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-16T11:20:29.004 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2024-09-16T11:20:29.101 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image testimg1 will expire at 2024-09-16T12:20:29.041863+0000 2024-09-16T11:20:29.106 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2024-09-16T11:20:29.209 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image testimg2 will expire at 2024-09-16T14:20:29.148130+0000 2024-09-16T11:20:29.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:29.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:29.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:29.248 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:29.248 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:29.281 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete...done. 2024-09-16T11:20:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:29.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:29.328 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:29.328 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2024-09-16T11:20:29.444 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:29.451 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:29.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:29.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:29.491 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:29.492 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:29.492 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:29.531 INFO:tasks.workunit.client.0.smithi137.stdout:2411e0bb2d4a testimg2 2024-09-16T11:20:29.531 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2024-09-16T11:20:29.664 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:29.669 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:29.669 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:29.669 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:29.709 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:29.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:29.779 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1@snap 2024-09-16T11:20:30.409 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:30.426 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-16T11:20:30.493 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:30.558 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:30.662 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:30.766 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:30.867 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:30.867 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:30.867 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:30.907 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:30.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:30.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:31.178 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:31.179 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:31.179 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:31.179 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:31.216 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:31.217 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:31.217 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:31.255 INFO:tasks.workunit.client.0.smithi137.stdout:243222be222a testimg1 2024-09-16T11:20:31.256 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:31.256 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{ print $1 }' 2024-09-16T11:20:31.300 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=243222be222a 2024-09-16T11:20:31.300 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 243222be222a 2024-09-16T11:20:31.403 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:20:31.422 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:31.529 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:31.534 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:31.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:31.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:31.571 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:31.571 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:31.645 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-16T11:20:31.710 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap 2024-09-16T11:20:32.431 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:32.447 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:32.523 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:32.627 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:32.736 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:32.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:32.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:32.848 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:32.888 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:32.888 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:32.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:33.159 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:33.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:33.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:33.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:33.202 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:33.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:33.202 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:33.242 INFO:tasks.workunit.client.0.smithi137.stdout:246237c2cb8b testimg2 2024-09-16T11:20:33.243 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:33.243 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{ print $1 }' 2024-09-16T11:20:33.288 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=246237c2cb8b 2024-09-16T11:20:33.289 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 246237c2cb8b 2024-09-16T11:20:33.420 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:20:33.441 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:33.541 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:33.545 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:33.545 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:33.545 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:33.579 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:33.580 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:33.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg2 2024-09-16T11:20:33.723 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:33.791 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg3@snap 2024-09-16T11:20:34.448 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:34.466 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:34.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:34.682 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:34.789 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:34.789 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:34.790 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:34.827 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:34.828 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:34.828 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:35.106 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:35.107 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:35.107 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:35.107 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:35.147 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:35.147 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:35.147 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg3 2024-09-16T11:20:35.188 INFO:tasks.workunit.client.0.smithi137.stdout:2492eead9910 testimg3 2024-09-16T11:20:35.189 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:35.189 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{ print $1 }' 2024-09-16T11:20:35.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=2492eead9910 2024-09-16T11:20:35.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 2492eead9910 2024-09-16T11:20:35.437 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:20:35.455 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:35.566 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:35.570 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:35.570 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:35.570 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:35.608 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:35.608 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:35.685 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1@snap 2024-09-16T11:20:36.458 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:36.472 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-16T11:20:36.589 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg1@snap 2024-09-16T11:20:36.871 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:36.888 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:36.952 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap 2024-09-16T11:20:37.400 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:37.424 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-16T11:20:37.547 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-16T11:20:37.675 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg2@snap 2024-09-16T11:20:37.758 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:37.777 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg4@snap 2024-09-16T11:20:38.476 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:38.492 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-16T11:20:38.641 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg4@snap 2024-09-16T11:20:38.744 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:38.759 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:38.861 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:38.973 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:39.095 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg4 2024-09-16T11:20:39.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:39.205 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:39.247 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:39.247 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:39.248 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:39.672 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:39.672 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.673 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:39.673 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:39.713 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:39.714 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.714 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:39.755 INFO:tasks.workunit.client.0.smithi137.stdout:24b95a5c5340 testimg1 2024-09-16T11:20:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.755 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:39.794 INFO:tasks.workunit.client.0.smithi137.stdout:24bf3c5e5e1d testimg2 2024-09-16T11:20:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg4 2024-09-16T11:20:39.836 INFO:tasks.workunit.client.0.smithi137.stdout:24cbf23dcdc9 testimg4 2024-09-16T11:20:39.836 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg6 2024-09-16T11:20:39.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:39.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:39.947 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:39.988 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:39.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:39.988 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:40.793 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:40.793 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:40.793 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:40.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:40.833 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:40.834 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:40.834 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:40.873 INFO:tasks.workunit.client.0.smithi137.stdout:24b95a5c5340 testimg1 2024-09-16T11:20:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:40.874 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:40.916 INFO:tasks.workunit.client.0.smithi137.stdout:24bf3c5e5e1d testimg2 2024-09-16T11:20:40.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg5 2024-09-16T11:20:41.022 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:41.023 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:41.064 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:41.097 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:41.235 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:41.231+0000 7f3802a27700 0 -- 172.21.15.137:0/1727085809 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f37dc054c80 msgr2=0x7f37dc057060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:41.260 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:41.255+0000 7f3802a27700 0 -- 172.21.15.137:0/1727085809 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f37e403aae0 msgr2=0x7f37e403cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:20:42.515 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:42.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:42.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:42.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:42.561 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:42.562 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:42.634 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1@snap 2024-09-16T11:20:43.482 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:43.498 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-16T11:20:43.620 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg1@snap 2024-09-16T11:20:43.697 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:43.715 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:43.789 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg3@snap 2024-09-16T11:20:44.496 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:44.510 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap 2024-09-16T11:20:45.496 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:45.517 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-16T11:20:45.650 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-16T11:20:45.774 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg2@snap 2024-09-16T11:20:45.867 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:45.884 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg4@snap 2024-09-16T11:20:46.498 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:46.515 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-16T11:20:46.667 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg4@snap 2024-09-16T11:20:46.764 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:46.783 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg1 2024-09-16T11:20:46.891 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg2 2024-09-16T11:20:46.999 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:47.106 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg4 2024-09-16T11:20:47.216 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:47.216 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:47.216 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:47.258 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:47.259 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:47.259 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:47.532 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:47.532 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:47.533 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:47.533 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:47.573 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:47.574 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg6 2024-09-16T11:20:47.691 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:47.692 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:47.692 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 5 2024-09-16T11:20:47.733 INFO:tasks.workunit.client.0.smithi137.stdout:5 2024-09-16T11:20:47.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:47.734 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:48.969 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:48.970 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:48.970 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:48.971 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:49.012 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:49.013 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:49.013 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:49.055 INFO:tasks.workunit.client.0.smithi137.stdout:25195aba9e2c testimg1 2024-09-16T11:20:49.056 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:49.056 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:49.096 INFO:tasks.workunit.client.0.smithi137.stdout:251f7b2c9929 testimg2 2024-09-16T11:20:49.097 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:49.097 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg3 2024-09-16T11:20:49.139 INFO:tasks.workunit.client.0.smithi137.stdout:252597fa62b7 testimg3 2024-09-16T11:20:49.140 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg5 2024-09-16T11:20:49.252 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:49.252 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:49.252 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:49.294 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:49.295 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:49.295 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:51.781 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:51.782 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:51.782 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:51.782 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:20:51.824 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:20:51.825 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:51.825 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg3 2024-09-16T11:20:51.872 INFO:tasks.workunit.client.0.smithi137.stdout:252597fa62b7 testimg3 2024-09-16T11:20:51.873 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:20:51.873 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{ print $1 }' 2024-09-16T11:20:51.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=252597fa62b7 2024-09-16T11:20:51.916 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 252597fa62b7 2024-09-16T11:20:52.401 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:20:52.416 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:52.521 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:20:52.525 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:52.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:52.526 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:20:52.563 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:20:52.563 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:20:52.637 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1@snap 2024-09-16T11:20:53.532 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:53.546 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-16T11:20:53.664 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg1@snap 2024-09-16T11:20:53.736 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:53.753 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:20:53.827 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap 2024-09-16T11:20:54.539 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:54.555 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-16T11:20:54.687 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-16T11:20:54.813 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg2@snap 2024-09-16T11:20:54.899 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:54.915 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg4@snap 2024-09-16T11:20:55.539 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:20:55.557 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-16T11:20:55.722 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg4@snap 2024-09-16T11:20:55.834 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:20:55.851 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2024-09-16T11:20:55.996 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:56.000 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2024-09-16T11:20:56.140 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:56.143 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:20:56.258 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2024-09-16T11:20:56.409 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:20:56.415 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:56.415 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:56.415 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:56.456 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:56.457 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:56.457 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:56.889 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:56.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:56.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:56.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:56.926 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:56.926 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:56.927 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:56.970 INFO:tasks.workunit.client.0.smithi137.stdout:25855e15c81b testimg1 2024-09-16T11:20:56.971 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:56.971 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:57.012 INFO:tasks.workunit.client.0.smithi137.stdout:258b836e1874 testimg2 2024-09-16T11:20:57.013 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:57.013 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg4 2024-09-16T11:20:57.055 INFO:tasks.workunit.client.0.smithi137.stdout:259781dcbb3a testimg4 2024-09-16T11:20:57.055 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg6 2024-09-16T11:20:57.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:57.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:57.160 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:20:57.200 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:20:57.201 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:57.201 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:20:58.611 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:20:58.612 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:58.612 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:58.612 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 2 2024-09-16T11:20:58.651 INFO:tasks.workunit.client.0.smithi137.stdout:2 2024-09-16T11:20:58.652 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:58.652 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:20:58.692 INFO:tasks.workunit.client.0.smithi137.stdout:25855e15c81b testimg1 2024-09-16T11:20:58.692 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:58.693 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:20:58.728 INFO:tasks.workunit.client.0.smithi137.stdout:258b836e1874 testimg2 2024-09-16T11:20:58.729 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg5 2024-09-16T11:20:58.842 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:20:58.842 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:20:58.842 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:20:58.880 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:20:58.880 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:20:59.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:59.054+0000 7f6e2a820700 0 -- 172.21.15.137:0/2296190851 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f6e0c054c80 msgr2=0x7f6e0c057060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:20:59.082 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:20:59.078+0000 7f6e2a820700 0 -- 172.21.15.137:0/2296190851 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f6e1003aac0 msgr2=0x7f6e1003cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:00.529 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:21:00.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:00.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:00.535 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:21:00.576 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:00.576 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg1 2024-09-16T11:21:00.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1@snap 2024-09-16T11:21:01.434 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:01.449 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2024-09-16T11:21:01.561 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg1@snap 2024-09-16T11:21:01.633 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:01.649 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 256 testimg3 2024-09-16T11:21:01.726 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg3@snap 2024-09-16T11:21:02.412 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:02.427 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap 2024-09-16T11:21:03.443 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:03.465 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2024-09-16T11:21:03.599 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2024-09-16T11:21:03.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg2@snap 2024-09-16T11:21:03.817 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:03.835 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg4@snap 2024-09-16T11:21:04.451 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:04.466 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2024-09-16T11:21:04.608 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm testimg4@snap 2024-09-16T11:21:04.710 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:04.729 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2024-09-16T11:21:04.888 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:04.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2024-09-16T11:21:05.043 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:05.048 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg3 2024-09-16T11:21:05.153 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2024-09-16T11:21:05.302 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:05.306 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:05.306 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:05.307 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:21:05.346 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:21:05.347 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:21:05.347 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:21:05.602 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:21:05.603 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:05.604 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:21:05.645 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:21:05.645 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg6 2024-09-16T11:21:05.756 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:05.756 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:05.756 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 5 2024-09-16T11:21:05.797 INFO:tasks.workunit.client.0.smithi137.stdout:5 2024-09-16T11:21:05.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:21:05.798 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:21:06.684 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:21:06.684 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:06.684 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:06.685 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 3 2024-09-16T11:21:06.727 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:21:06.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:06.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg1 2024-09-16T11:21:06.768 INFO:tasks.workunit.client.0.smithi137.stdout:25e4c9202a54 testimg1 2024-09-16T11:21:06.768 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:06.768 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg2 2024-09-16T11:21:06.813 INFO:tasks.workunit.client.0.smithi137.stdout:25ea67ffbdb8 testimg2 2024-09-16T11:21:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:06.813 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg3 2024-09-16T11:21:06.857 INFO:tasks.workunit.client.0.smithi137.stdout:25efd9532019 testimg3 2024-09-16T11:21:06.857 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash mv testimg5 2024-09-16T11:21:06.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:06.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:06.960 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 4 2024-09-16T11:21:06.999 INFO:tasks.workunit.client.0.smithi137.stdout:4 2024-09-16T11:21:07.000 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:21:07.000 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'some expired images could not be removed' 2024-09-16T11:21:08.631 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: some expired images could not be removed 2024-09-16T11:21:08.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:08.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:08.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:21:08.671 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:21:08.671 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:08.672 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep testimg3 2024-09-16T11:21:08.708 INFO:tasks.workunit.client.0.smithi137.stdout:25efd9532019 testimg3 2024-09-16T11:21:08.709 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd trash ls 2024-09-16T11:21:08.710 INFO:tasks.workunit.client.0.smithi137.stderr:++ awk '{ print $1 }' 2024-09-16T11:21:08.754 INFO:tasks.workunit.client.0.smithi137.stderr:+ ID=25efd9532019 2024-09-16T11:21:08.754 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge --image-id 25efd9532019 2024-09-16T11:21:09.453 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:21:09.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash purge 2024-09-16T11:21:09.587 INFO:tasks.workunit.client.0.smithi137.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2024-09-16T11:21:09.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls 2024-09-16T11:21:09.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:09.593 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 0 2024-09-16T11:21:09.631 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_deep_copy_clone 2024-09-16T11:21:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing deep copy clone...' 2024-09-16T11:21:09.632 INFO:tasks.workunit.client.0.smithi137.stdout:testing deep copy clone... 2024-09-16T11:21:09.632 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:21:09.633 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:09.766 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:09.902 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.039 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.171 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.315 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.657 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.791 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:10.927 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.270 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.408 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.551 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.687 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.821 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:11.957 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:12.095 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:12.228 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:12.358 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:12.499 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create testimg1 --image-format 2 --size 256 2024-09-16T11:21:12.582 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg1 --snap=snap1 2024-09-16T11:21:13.467 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:13.483 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect testimg1@snap1 2024-09-16T11:21:13.549 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone testimg1@snap1 testimg2 2024-09-16T11:21:13.667 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap2 2024-09-16T11:21:14.484 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:14.503 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy testimg2 testimg3 2024-09-16T11:21:14.699 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:14.694+0000 7f3a0fa93700 0 -- 172.21.15.137:0/776778366 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f39f4008af0 msgr2=0x7f39f400af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:15.490 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete...2024-09-16T11:21:15.486+0000 7f3a0fa93700 0 -- 172.21.15.137:0/776778366 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f39f003a9c0 msgr2=0x7f39f003cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:15.490 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 100% complete...done. 2024-09-16T11:21:15.496 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:21:15.497 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:21:15.572 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:21:15.572 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:21:15.573 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'parent: rbd/testimg1@snap1' 2024-09-16T11:21:15.640 INFO:tasks.workunit.client.0.smithi137.stdout: parent: rbd/testimg1@snap1 2024-09-16T11:21:15.641 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg3 2024-09-16T11:21:15.642 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:21:15.642 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:21:15.642 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:15.718 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:21:15.718 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg3 2024-09-16T11:21:15.719 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '.*snap2.*' 2024-09-16T11:21:15.795 INFO:tasks.workunit.client.0.smithi137.stdout: 76 snap2 256 MiB Mon Sep 16 11:21:15 2024 2024-09-16T11:21:15.796 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg2 2024-09-16T11:21:15.796 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'features:.*deep-flatten' 2024-09-16T11:21:15.877 INFO:tasks.workunit.client.0.smithi137.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-16T11:21:15.877 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:21:15.877 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'features:.*deep-flatten' 2024-09-16T11:21:15.954 INFO:tasks.workunit.client.0.smithi137.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-16T11:21:15.954 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd flatten testimg2 2024-09-16T11:21:16.045 INFO:tasks.workunit.client.0.smithi137.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-16T11:21:16.064 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd flatten testimg3 2024-09-16T11:21:16.156 INFO:tasks.workunit.client.0.smithi137.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-16T11:21:16.173 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect testimg1@snap1 2024-09-16T11:21:16.242 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge testimg2 2024-09-16T11:21:16.473 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:21:16.495 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap purge testimg3 2024-09-16T11:21:17.407 INFO:tasks.workunit.client.0.smithi137.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-16T11:21:17.432 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg2 2024-09-16T11:21:17.641 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-16T11:21:17.634+0000 7fe2632d0700 0 -- 172.21.15.137:0/3041009665 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fe24403aaf0 msgr2=0x7fe24403cf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:17.658 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:17.663 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm testimg3 2024-09-16T11:21:17.883 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-16T11:21:17.878+0000 7f4e21da8700 0 -- 172.21.15.137:0/1672225013 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f4e08008980 msgr2=0x7f4e0800ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:17.884 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:17.888 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect testimg1@snap1 2024-09-16T11:21:17.962 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone testimg1@snap1 testimg2 2024-09-16T11:21:18.075 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create testimg2@snap2 2024-09-16T11:21:18.504 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:18.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd deep copy --flatten testimg2 testimg3 2024-09-16T11:21:19.623 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete...2024-09-16T11:21:19.618+0000 7f38637cf700 0 -- 172.21.15.137:0/3351554716 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5627ddec2940 msgr2=0x5627ddfb2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:19.734 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:19.730+0000 7f3862fce700 0 -- 172.21.15.137:0/3351554716 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f383c003180 msgr2=0x7f383c012760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:20.380 INFO:tasks.workunit.client.0.smithi137.stderr: Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2024-09-16T11:21:20.387 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:21:20.387 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'size 256 MiB' 2024-09-16T11:21:20.443 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:21:20.444 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg3 2024-09-16T11:21:20.444 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v parent: 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout:rbd image 'testimg3': 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: size 256 MiB in 64 objects 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: order 22 (4 MiB objects) 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: snapshot_count: 1 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: id: 26fb518a550e 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: block_name_prefix: rbd_data.26fb518a550e 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: format: 2 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: op_features: 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: flags: 2024-09-16T11:21:20.506 INFO:tasks.workunit.client.0.smithi137.stdout: create_timestamp: Mon Sep 16 11:21:18 2024 2024-09-16T11:21:20.507 INFO:tasks.workunit.client.0.smithi137.stdout: access_timestamp: Mon Sep 16 11:21:18 2024 2024-09-16T11:21:20.507 INFO:tasks.workunit.client.0.smithi137.stdout: modify_timestamp: Mon Sep 16 11:21:18 2024 2024-09-16T11:21:20.507 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg3 2024-09-16T11:21:20.507 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -v SNAPID 2024-09-16T11:21:20.507 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:20.508 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 1 2024-09-16T11:21:20.566 INFO:tasks.workunit.client.0.smithi137.stdout:1 2024-09-16T11:21:20.567 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap ls testimg3 2024-09-16T11:21:20.567 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '.*snap2.*' 2024-09-16T11:21:20.625 INFO:tasks.workunit.client.0.smithi137.stdout: 80 snap2 256 MiB Mon Sep 16 11:21:19 2024 2024-09-16T11:21:20.626 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd info testimg2 2024-09-16T11:21:20.626 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'features:.*deep-flatten' 2024-09-16T11:21:20.701 INFO:tasks.workunit.client.0.smithi137.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-16T11:21:20.702 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd flatten testimg2 2024-09-16T11:21:20.784 INFO:tasks.workunit.client.0.smithi137.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2024-09-16T11:21:20.800 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect testimg1@snap1 2024-09-16T11:21:20.879 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:21:20.880 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:21.744 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:22.627 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:23.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:23.976 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.121 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.258 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.403 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.544 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.688 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.827 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:24.966 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.103 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.245 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.385 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.520 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.658 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.794 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:25.931 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_clone_v2 2024-09-16T11:21:25.931 INFO:tasks.workunit.client.0.smithi137.stdout:testing clone v2... 2024-09-16T11:21:25.932 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing clone v2...' 2024-09-16T11:21:25.932 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:21:25.932 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.077 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.214 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.354 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.496 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.644 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.781 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:26.921 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.060 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.195 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.337 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.614 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.749 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:27.893 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:28.035 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:28.172 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:28.316 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:28.452 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:21:28.541 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@1 2024-09-16T11:21:29.432 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:29.449 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2024-09-16T11:21:29.509 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:29.502+0000 7f1fc77fe700 -1 librbd::image::CloneRequest: 0x55f0e07bb800 validate_parent: parent snapshot must be protected 2024-09-16T11:21:29.509 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: clone error: (22) Invalid argument 2024-09-16T11:21:29.514 INFO:tasks.workunit.client.0.smithi137.stderr:+ true 2024-09-16T11:21:29.514 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2024-09-16T11:21:29.630 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2024-09-16T11:21:29.746 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap protect test1@1 2024-09-16T11:21:29.817 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2024-09-16T11:21:29.949 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd children test1@1 2024-09-16T11:21:29.949 INFO:tasks.workunit.client.0.smithi137.stderr:+ sort 2024-09-16T11:21:29.949 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr '\n' ' ' 2024-09-16T11:21:29.949 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -E 'test2.*test3.*test4' 2024-09-16T11:21:30.024 INFO:tasks.workunit.client.0.smithi137.stdout:rbd/test2 rbd/test3 rbd/test4 2024-09-16T11:21:30.025 INFO:tasks.workunit.client.0.smithi137.stderr:+ sort 2024-09-16T11:21:30.025 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr '\n' ' ' 2024-09-16T11:21:30.025 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -E 'test2.*test3.*test4' 2024-09-16T11:21:30.025 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd children --descendants test1 2024-09-16T11:21:30.118 INFO:tasks.workunit.client.0.smithi137.stdout:rbd/test2 rbd/test3 rbd/test4 2024-09-16T11:21:30.118 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd remove test4 2024-09-16T11:21:30.341 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:30.334+0000 7f6820b74700 0 -- 172.21.15.137:0/39351895 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55896717d650 msgr2=0x558967194b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:30.346 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:30.351 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap unprotect test1@1 2024-09-16T11:21:30.427 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap remove test1@1 2024-09-16T11:21:30.500 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:30.518 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap list --all test1 2024-09-16T11:21:30.518 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep -E 'trash \(1\) *$' 2024-09-16T11:21:30.579 INFO:tasks.workunit.client.0.smithi137.stdout: 84 850241c7-514f-495f-9695-200804ea074e 1 MiB Mon Sep 16 11:21:29 2024 trash (1) 2024-09-16T11:21:30.579 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@2 2024-09-16T11:21:31.448 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:31.466 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:31.466 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'image has snapshots' 2024-09-16T11:21:31.571 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2024-09-16T11:21:31.571 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm test1@2 2024-09-16T11:21:32.441 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:32.457 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:32.457 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'linked clones' 2024-09-16T11:21:32.560 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-16T11:21:32.560 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test3 2024-09-16T11:21:32.751 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:32.746+0000 7f8bdcda0700 0 -- 172.21.15.137:0/3697276445 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f8bc0008980 msgr2=0x7f8bc000ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:32.780 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:32.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:32.784 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep 'linked clones' 2024-09-16T11:21:32.888 INFO:tasks.workunit.client.0.smithi137.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-16T11:21:32.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd flatten test2 2024-09-16T11:21:33.464 INFO:tasks.workunit.client.0.smithi137.stderr: Image flatten: 100% complete...done. 2024-09-16T11:21:33.483 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap list --all test1 2024-09-16T11:21:33.483 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:33.484 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:21:33.541 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:33.541 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:33.758 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:33.754+0000 7fd9497ab700 0 -- 172.21.15.137:0/3482375379 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fd924008980 msgr2=0x7fd92400ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:33.758 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:33.762 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:21:33.949 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:33.942+0000 7f1cf01f7700 0 -- 172.21.15.137:0/3085446151 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f1cd403a9e0 msgr2=0x7f1cd403ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:33.970 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:33.976 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 -s 1 test1 2024-09-16T11:21:34.053 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@1 2024-09-16T11:21:34.471 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:34.487 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create test1@2 2024-09-16T11:21:35.472 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:21:35.490 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2024-09-16T11:21:35.610 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2024-09-16T11:21:35.727 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm test1@1 2024-09-16T11:21:35.799 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:35.817 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm test1@2 2024-09-16T11:21:35.890 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:21:35.906 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd rm test1 2024-09-16T11:21:35.906 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:35.994 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:35.986+0000 7fb81f52e4c0 -1 librbd::api::Image: remove: image has snapshots - not removing 2024-09-16T11:21:35.994 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 0% complete...failed. 2024-09-16T11:21:36.006 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2024-09-16T11:21:36.011 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:21:36.011 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2024-09-16T11:21:36.148 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:36.153 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -a 2024-09-16T11:21:36.154 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:36.198 INFO:tasks.workunit.client.0.smithi137.stdout:282f2ec3a2dc test1 2024-09-16T11:21:36.199 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test2 2024-09-16T11:21:36.375 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:36.370+0000 7fe961bb8700 0 -- 172.21.15.137:0/1901610314 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7fe940006710 msgr2=0x7fe940012820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:36.454 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:36.450+0000 7fe961bb8700 0 -- 172.21.15.137:0/1901610314 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55929f955250 msgr2=0x55929f9eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:36.532 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:36.538 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -a 2024-09-16T11:21:36.538 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:36.582 INFO:tasks.workunit.client.0.smithi137.stdout:282f2ec3a2dc test1 2024-09-16T11:21:36.583 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test3 2024-09-16T11:21:36.976 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:36.969+0000 7f99b5129700 0 -- 172.21.15.137:0/576448917 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f9994001ec0 msgr2=0x7f9994008000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:37.004 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:36.997+0000 7f99b5129700 0 -- 172.21.15.137:0/576448917 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f999803aae0 msgr2=0x7f999803cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:37.475 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:37.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd trash ls -a 2024-09-16T11:21:37.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail grep test1 2024-09-16T11:21:37.480 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:37.527 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:21:37.528 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_thick_provision 2024-09-16T11:21:37.528 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing thick provision...' 2024-09-16T11:21:37.528 INFO:tasks.workunit.client.0.smithi137.stdout:testing thick provision... 2024-09-16T11:21:37.528 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:21:37.529 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:37.664 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:37.806 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:37.944 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.086 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.231 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.366 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.502 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.636 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.781 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:38.908 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.047 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.187 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.475 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.823 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:39.963 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:40.102 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:40.238 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2024-09-16T11:21:40.634 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-16T11:21:40.664 INFO:tasks.workunit.client.0.smithi137.stderr:+ count=0 2024-09-16T11:21:40.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret= 2024-09-16T11:21:40.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 -lt 10 ']' 2024-09-16T11:21:40.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:21:40.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:40.665 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr -s ' ' 2024-09-16T11:21:40.666 INFO:tasks.workunit.client.0.smithi137.stderr:+ cut -d ' ' -f 4-5 2024-09-16T11:21:40.666 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^64 MiB' 2024-09-16T11:21:40.715 INFO:tasks.workunit.client.0.smithi137.stdout:64 MiB 2024-09-16T11:21:40.715 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret=0 2024-09-16T11:21:40.715 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 = 0 ']' 2024-09-16T11:21:40.716 INFO:tasks.workunit.client.0.smithi137.stderr:+ break 2024-09-16T11:21:40.716 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:21:40.765 INFO:tasks.workunit.client.0.smithi137.stdout:NAME PROVISIONED USED 2024-09-16T11:21:40.765 INFO:tasks.workunit.client.0.smithi137.stdout:test1 64 MiB 64 MiB 2024-09-16T11:21:40.770 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 '!=' 0 ']' 2024-09-16T11:21:40.770 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:40.987 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2024-09-16T11:21:40.981+0000 7f8a502d9700 0 -- 172.21.15.137:0/2381260556 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f8a3003ac90 msgr2=0x7f8a3003d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:41.035 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:41.029+0000 7f8a50ada700 0 -- 172.21.15.137:0/2381260556 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556060d69850 msgr2=0x556060e0c600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:41.038 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:21:41.043 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:21:41.043 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:41.044 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:41.044 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:21:41.084 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:41.084 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2024-09-16T11:21:41.641 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2024-09-16T11:21:41.633+0000 7f23d5874700 0 -- 172.21.15.137:0/3707581078 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a1944985a0 msgr2=0x55a194484bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:41.763 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 6% complete...2024-09-16T11:21:41.757+0000 7f23d5073700 0 -- 172.21.15.137:0/3707581078 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a194585ab0 msgr2=0x55a194587f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:52.821 INFO:tasks.workunit.client.0.smithi137.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2024-09-16T11:21:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ count=0 2024-09-16T11:21:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret= 2024-09-16T11:21:52.838 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 -lt 10 ']' 2024-09-16T11:21:52.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:21:52.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:52.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ tr -s ' ' 2024-09-16T11:21:52.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ cut -d ' ' -f 4-5 2024-09-16T11:21:52.839 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^4 GiB' 2024-09-16T11:21:52.888 INFO:tasks.workunit.client.0.smithi137.stdout:4 GiB 2024-09-16T11:21:52.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ ret=0 2024-09-16T11:21:52.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 = 0 ']' 2024-09-16T11:21:52.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ break 2024-09-16T11:21:52.889 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd du 2024-09-16T11:21:52.940 INFO:tasks.workunit.client.0.smithi137.stdout:NAME PROVISIONED USED 2024-09-16T11:21:52.940 INFO:tasks.workunit.client.0.smithi137.stdout:test1 4 GiB 4 GiB 2024-09-16T11:21:52.944 INFO:tasks.workunit.client.0.smithi137.stderr:+ '[' 0 '!=' 0 ']' 2024-09-16T11:21:52.945 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm test1 2024-09-16T11:21:53.145 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image2024-09-16T11:21:53.137+0000 7f0ca2073700 0 -- 172.21.15.137:0/3103847874 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0c7c0060e0 msgr2=0x7f0c7c008590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:53.165 INFO:tasks.workunit.client.0.smithi137.stderr:: 2% complete... Removing image: 3% complete... Removing image: 4% complete...2024-09-16T11:21:53.157+0000 7f0ca2073700 0 -- 172.21.15.137:0/3103847874 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f0c8403a8f0 msgr2=0x7f0c8403cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:54.167 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2024-09-16T11:21:54.171 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd ls 2024-09-16T11:21:54.171 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:54.171 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test1 2024-09-16T11:21:54.171 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:21:54.207 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:54.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ test_namespace 2024-09-16T11:21:54.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ echo 'testing namespace...' 2024-09-16T11:21:54.208 INFO:tasks.workunit.client.0.smithi137.stdout:testing namespace... 2024-09-16T11:21:54.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ remove_images 2024-09-16T11:21:54.208 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:54.332 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:54.467 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:54.592 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:54.728 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:54.863 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.001 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.146 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.287 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.436 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.578 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.719 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:55.858 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.196 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.337 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.482 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.610 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.750 INFO:tasks.workunit.client.0.smithi137.stderr:+ for img in $IMGS 2024-09-16T11:21:56.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace ls 2024-09-16T11:21:56.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:56.892 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^0$' 2024-09-16T11:21:56.934 INFO:tasks.workunit.client.0.smithi137.stdout:0 2024-09-16T11:21:56.934 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create rbd/test1 2024-09-16T11:21:56.983 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create --pool rbd --namespace test2 2024-09-16T11:21:57.040 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create --namespace test3 2024-09-16T11:21:57.091 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd namespace create rbd/test3 2024-09-16T11:21:57.091 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace create rbd/test3 2024-09-16T11:21:57.132 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: failed to created namespace: 2024-09-16T11:21:57.125+0000 7f5325db34c0 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2024-09-16T11:21:57.132 INFO:tasks.workunit.client.0.smithi137.stderr:(17) File exists 2024-09-16T11:21:57.137 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:21:57.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace list 2024-09-16T11:21:57.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep test 2024-09-16T11:21:57.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ grep '^3$' 2024-09-16T11:21:57.138 INFO:tasks.workunit.client.0.smithi137.stderr:+ wc -l 2024-09-16T11:21:57.175 INFO:tasks.workunit.client.0.smithi137.stdout:3 2024-09-16T11:21:57.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2024-09-16T11:21:57.176 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd namespace remove --pool rbd missing 2024-09-16T11:21:57.201 INFO:tasks.workunit.client.0.smithi137.stderr:rbd: namespace name was not specified 2024-09-16T11:21:57.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ return 0 2024-09-16T11:21:57.203 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2024-09-16T11:21:57.278 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2024-09-16T11:21:57.349 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2024-09-16T11:21:57.706 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:57.701+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb770e20 msgr2=0x55a9bb82e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:57.719 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:57.713+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f92ec03a9c0 msgr2=0x7f92ec03cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:57.724 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:57.717+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb770e20 msgr2=0x7f92ec0baf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:57.730 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:57.725+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f92ec03a9c0 msgr2=0x7f92ec03cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:21:57.889 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:57.881+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a9bb87be90 msgr2=0x55a9bb87e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:58.731 INFO:tasks.workunit.client.0.smithi137.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-16T11:21:58.732 INFO:tasks.workunit.client.0.smithi137.stdout: 1 3472 2527.6 9.9 MiB/s 2024-09-16T11:21:59.354 INFO:tasks.workunit.client.0.smithi137.stdout: 2 4624 2315.42 9.0 MiB/s 2024-09-16T11:21:59.440 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:59.429+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb87be90 msgr2=0x7f92ec041470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:21:59.813 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:21:59.805+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a9bb87be90 msgr2=0x7f92ec097370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:00.106 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:00.097+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb770e20 msgr2=0x7f92ec0baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:00.352 INFO:tasks.workunit.client.0.smithi137.stdout: 3 5600 1872.04 7.3 MiB/s 2024-09-16T11:22:00.668 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:00.661+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f92ec03a9c0 msgr2=0x7f92ec03cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:00.948 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:00.941+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f92ec03a9c0 msgr2=0x7f92ec03cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:01.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.165+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a9bb770e20 msgr2=0x7f92ec0baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:01.174 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.165+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a9bb770e20 msgr2=0x7f92ec0baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:01.331 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.325+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb87be90 msgr2=0x7f92ec096af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:01.600 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.593+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb770e20 msgr2=0x7f92ec0baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:01.601 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.593+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f92ec03a9c0 msgr2=0x7f92ec03cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:01.840 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.833+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb770e20 msgr2=0x7f92ec0baef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:01.873 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:01.865+0000 7f9306830700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x55a9bb87be90 msgr2=0x7f92ec096af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:02.305 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:02.297+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x55a9bb87be90 msgr2=0x7f92ec03cda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:02.805 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:02.797+0000 7f9307031700 0 -- 172.21.15.137:0/3866758758 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x7f92ec03a9c0 msgr2=0x7f92ec106370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:02.917 INFO:tasks.workunit.client.0.smithi137.stdout:elapsed: 5 ops: 8192 ops/sec: 1471.3 bytes/sec: 5.7 MiB/s 2024-09-16T11:22:02.936 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap create rbd/test1/image1@1 2024-09-16T11:22:03.776 INFO:tasks.workunit.client.0.smithi137.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-16T11:22:03.792 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd clone --rbd-default-clone-format 2 rbd/test1/image1@1 rbd/test2/image1 2024-09-16T11:22:03.948 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd snap rm rbd/test1/image1@1 2024-09-16T11:22:04.020 INFO:tasks.workunit.client.0.smithi137.stderr: Removing snap: 100% complete...done. 2024-09-16T11:22:04.038 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export rbd/test1/image1 - 2024-09-16T11:22:04.038 INFO:tasks.workunit.client.0.smithi137.stderr:+ cmp /dev/fd/63 /dev/fd/62 2024-09-16T11:22:04.039 INFO:tasks.workunit.client.0.smithi137.stderr:++ rbd export rbd/test2/image1 - 2024-09-16T11:22:04.348 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete...2024-09-16T11:22:04.341+0000 7f76058b6700 0 -- 172.21.15.137:0/3376321994 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x556189752890 msgr2=0x556189767f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:04.364 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:04.357+0000 7f76050b5700 0 -- 172.21.15.137:0/3376321994 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x5561897b5fc0 msgr2=0x5561897b83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:04.565 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete...2024-09-16T11:22:04.557+0000 7f030118e700 0 -- 172.21.15.137:0/3088533481 >> [v2:172.21.15.137:6800/20976,v1:172.21.15.137:6801/20976] conn(0x558ac7602140 msgr2=0x558ac7617360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:04.632 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete...2024-09-16T11:22:04.625+0000 7f030098d700 0 -- 172.21.15.137:0/3088533481 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x558ac7665050 msgr2=0x558ac7667430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:05.964 INFO:tasks.workunit.client.0.smithi137.stderr: Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 99% complete... Exporting imageExporting image: 100% complete...done.: 100% complete...done. 2024-09-16T11:22:05.964 INFO:tasks.workunit.client.0.smithi137.stderr: 2024-09-16T11:22:05.971 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd rm rbd/test2/image1 2024-09-16T11:22:06.185 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete...2024-09-16T11:22:06.177+0000 7fdafaaed700 0 -- 172.21.15.137:0/2686683681 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x5628054a61f0 msgr2=0x5628054b8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:06.754 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:06.749+0000 7fdafa2ec700 0 -- 172.21.15.137:0/2686683681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56280549cde0 msgr2=0x56280540c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T11:22:06.820 INFO:tasks.workunit.client.0.smithi137.stderr: Removing image: 100% complete...done. 2024-09-16T11:22:06.826 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd create --image-format 2 --size 1G rbd/image2 2024-09-16T11:22:06.899 INFO:tasks.workunit.client.0.smithi137.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/image2 2024-09-16T11:22:06.978 INFO:tasks.workunit.client.0.smithi137.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2024-09-16T11:22:07.558 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T11:22:07.553+0000 7f612a705700 0 -- 172.21.15.137:0/3659342895 >> [v2:172.21.15.137:6803/20975,v1:172.21.15.137:6805/20975] conn(0x7f610c03a9f0 msgr2=0x7f610c03ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-16T11:22:37.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:37.324+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.10621.0:933 3.2 3:541bc2d1:::rbd_data.297afc23426c.0000000000000036:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1261568~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:37.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:37.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.10621.0:661 3.1 3:a8cb7dec:::rbd_data.297afc23426c.0000000000000072:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2793472~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:38.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:38.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:38.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:38.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:39.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:39.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:39.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:39.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:40.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:40.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:40.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:40.828+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:41.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:41.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:41.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:41.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:42.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:42.320+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:42.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:42.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:43.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:43.368+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:43.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:43.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:44.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:44.324+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:44.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:44.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:45.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:45.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:45.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:45.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:46.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:46.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:46.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:46.916+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:47.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:47.368+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:47.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:47.960+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:48.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:48.348+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:48.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:48.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:49.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:49.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:49.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:49.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:50.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:50.360+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:50.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:50.916+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:51.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:51.312+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:51.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:51.960+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:52.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:52.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:52.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:52.976+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:53.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:53.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:54.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:54.024+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:54.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:54.280+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:55.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:55.072+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:55.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:55.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:56.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:56.040+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:56.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:56.204+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:57.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:57.040+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:57.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:57.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:58.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:58.056+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:58.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:58.212+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:59.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:22:59.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:22:59.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:22:59.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:00.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:00.060+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:00.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:00.243+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:01.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:01.015+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:01.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:01.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:02.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:01.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:02.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:02.215+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:03.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:03.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:03.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:03.243+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:04.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:04.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:04.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:04.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:05.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:05.031+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:05.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:05.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:06.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:06.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:06.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:06.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:06.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:06.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:07.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:07.323+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:07.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:07.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:08.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:08.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:08.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:08.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:09.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:09.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:09.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:09.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:10.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:10.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:10.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:10.939+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:11.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:11.287+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:11.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:11.991+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:12.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:12.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:13.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:13.039+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:13.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:13.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:14.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:14.071+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:14.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:14.267+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:15.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:15.063+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:15.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:15.219+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:16.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:16.019+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:16.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:16.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:17.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:17.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:17.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:17.211+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:17.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:17.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:18.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:18.239+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:18.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:18.939+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:19.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:19.247+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:19.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:19.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:20.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:20.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:20.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:20.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:21.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:21.275+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:21.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:21.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:22.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:22.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:22.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:22.987+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:23.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:23.247+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:23.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:23.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:24.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:24.207+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:24.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:24.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:25.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:25.255+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:25.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:25.903+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:26.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:26.255+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:26.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:26.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:27.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:27.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:27.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:27.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:28.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:28.263+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:28.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:28.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:29.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:29.263+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:29.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:29.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:30.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:30.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:30.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:30.911+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:31.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:31.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:31.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:31.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:32.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:32.271+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:32.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:32.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:33.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:33.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:33.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:33.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:34.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:34.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:34.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:34.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:35.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:35.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:35.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:35.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:36.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:36.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:36.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:36.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:37.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:37.307+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:37.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:37.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:38.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:38.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:38.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:38.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:39.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:39.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:39.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:39.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:40.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:40.287+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:40.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:40.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:41.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:41.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:41.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:41.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:42.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:42.274+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:42.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:42.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:43.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:43.242+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:43.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:43.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:44.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:44.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:45.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:45.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:45.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:45.254+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:46.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:46.042+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:46.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:46.298+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:47.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:46.998+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:47.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:47.290+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:48.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:48.010+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:48.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:48.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:49.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:49.054+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:49.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:49.326+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:50.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:50.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:50.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:50.342+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:51.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:51.122+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:51.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:51.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:52.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:52.106+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:52.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:52.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:53.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:53.150+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:53.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:53.358+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:54.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:54.190+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:54.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:54.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:55.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:55.222+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:55.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:55.330+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:56.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:56.198+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:56.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:56.330+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:57.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:57.214+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:57.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:57.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:58.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:58.210+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:58.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:58.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:59.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:23:59.174+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:23:59.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:23:59.354+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:00.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:00.218+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:00.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:00.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:01.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:01.210+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:01.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:01.398+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:02.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:02.246+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:02.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:02.442+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:03.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:03.202+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:03.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:03.418+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:04.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:04.154+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:04.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:04.386+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:05.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:05.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:05.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:05.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:06.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:06.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:06.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:06.386+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:07.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:07.122+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:07.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:07.342+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:08.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:08.162+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:08.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:08.366+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:09.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:09.150+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:09.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:09.418+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:10.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:10.162+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:10.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:10.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:11.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:11.170+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:11.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:11.350+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:12.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:12.138+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:12.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:12.354+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:13.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:13.134+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:13.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:13.370+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:14.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:14.110+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:14.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:14.350+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:15.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:15.082+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:15.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:15.354+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:16.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:16.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:16.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:16.326+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:17.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:17.058+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:17.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:17.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:18.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:18.058+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:18.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:18.306+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:19.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:19.090+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:19.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:19.318+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:20.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:20.126+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:20.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:20.370+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:21.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:21.130+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:21.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:21.390+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:22.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:22.178+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:22.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:22.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:23.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:23.170+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:23.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:23.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:24.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:24.158+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:24.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:24.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:25.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:25.205+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:25.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:25.357+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:26.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:26.221+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:26.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:26.341+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:27.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:27.205+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:27.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:27.325+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:28.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:28.177+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:28.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:28.349+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:29.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:29.153+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:29.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:29.321+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:30.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:30.189+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:30.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:30.289+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:31.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:31.193+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:31.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:31.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:32.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:32.157+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:32.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:32.245+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:33.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:33.185+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:33.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:33.241+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:34.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:34.141+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:34.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:34.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:35.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:35.165+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:35.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:35.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:36.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:36.125+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:36.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:36.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:37.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:37.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:37.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:37.289+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:38.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:38.113+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:38.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:38.289+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:39.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:39.065+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:39.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:39.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:40.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:40.017+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:40.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:40.297+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:41.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:41.041+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:41.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:41.317+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:42.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:42.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:42.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:42.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:43.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:43.117+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:43.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:43.337+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:44.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:44.165+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:44.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:44.317+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:45.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:45.149+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:45.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:45.301+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:46.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:46.149+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:46.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:46.333+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:47.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:47.177+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:47.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:47.365+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:48.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:48.145+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:48.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:48.317+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:49.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:49.149+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:49.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:49.293+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:50.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:50.121+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:50.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:50.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:51.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:51.157+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:51.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:51.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:52.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:52.169+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:52.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:52.297+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:53.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:53.129+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:53.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:53.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:54.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:54.133+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:54.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:54.357+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:55.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:55.181+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:55.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:55.325+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:56.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:56.181+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:56.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:56.285+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:57.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:57.209+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:57.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:57.293+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:58.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:58.221+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:58.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:58.317+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:59.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:24:59.261+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:24:59.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:24:59.297+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:00.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:00.237+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:00.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:00.305+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:01.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:01.269+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:01.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:01.297+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:02.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:02.281+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:02.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:02.289+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:03.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:03.277+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:03.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:03.277+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:04.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:04.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:04.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:04.293+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:05.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:05.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:05.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:05.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:06.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:06.249+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:06.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:06.281+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:07.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:07.281+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:07.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:07.309+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:08.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:08.301+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:08.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:08.345+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:09.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:09.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:09.358 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:09.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:10.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:10.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:10.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:10.357+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:11.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:11.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:11.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:11.368+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:12.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:12.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:12.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:12.352+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:13.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:13.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:13.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:13.352+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:14.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:14.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:14.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:14.332+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:15.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:15.304+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:15.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:15.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:16.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:16.256+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:16.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:16.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:17.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:17.256+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:17.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:17.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:18.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:18.208+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:18.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:18.376+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:19.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:19.260+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:19.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:19.376+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:20.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:20.272+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:20.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:20.388+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:21.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:21.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:21.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:21.408+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:22.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:22.252+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:22.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:22.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:23.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:23.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:23.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:23.416+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:24.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:24.216+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:24.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:24.368+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:25.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:25.224+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:25.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:25.336+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:26.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:26.232+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:26.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:26.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:27.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:27.204+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:27.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:27.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:28.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:28.200+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:28.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:28.276+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:29.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:29.176+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:29.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:29.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:30.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:30.208+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:30.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:30.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:31.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:31.232+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:31.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:31.304+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:32.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:32.220+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:32.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:32.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:33.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:33.192+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:33.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:33.304+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:34.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:34.156+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:34.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:34.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:35.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:35.116+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:35.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:35.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:36.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:36.096+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:36.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:36.384+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:37.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:37.104+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:37.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:37.384+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:38.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:38.148+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:38.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:38.356+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:39.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:39.100+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:39.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:39.332+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:40.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:40.072+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:40.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:40.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:41.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:41.100+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:41.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:41.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:42.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:42.148+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:42.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:42.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:43.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:43.144+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:43.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:43.212+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:44.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:44.128+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:44.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:44.216+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:45.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:45.160+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:45.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:45.196+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:46.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:46.152+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:46.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:46.208+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:47.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:47.132+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:47.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:47.232+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:48.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:48.112+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:48.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:48.240+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:49.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:49.132+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:49.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:49.200+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:50.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:50.152+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:50.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:50.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:51.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:51.128+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:51.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:51.244+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:52.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:52.156+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:52.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:52.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:53.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:53.132+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:53.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:53.244+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:54.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:54.120+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:54.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:54.276+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:55.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:55.128+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:55.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:55.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:56.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:56.116+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:56.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:56.296+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:57.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:57.128+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:57.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:57.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:58.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:58.131+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:58.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:58.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:59.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:25:59.155+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:25:59.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:25:59.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:00.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:00.139+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:00.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:00.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:01.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:01.135+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:01.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:01.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:02.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:02.115+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:02.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:02.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:03.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:03.067+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:03.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:03.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:04.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:04.083+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:04.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:04.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:05.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:05.111+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:05.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:05.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:06.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:06.147+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:06.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:06.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:07.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:07.171+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:07.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:07.267+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:08.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:08.143+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:08.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:08.267+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:09.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:09.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:09.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:09.243+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:10.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:10.183+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:10.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:10.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:11.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:11.171+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:11.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:11.287+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:12.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:12.131+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:12.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:12.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:13.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:13.147+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:13.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:13.323+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:14.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:14.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:14.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:14.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:15.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:15.151+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:15.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:15.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:16.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:16.135+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:16.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:16.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:17.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:17.147+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:17.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:17.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:18.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:18.135+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:18.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:18.267+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:19.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:19.135+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:19.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:19.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:20.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:20.119+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:20.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:20.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:21.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:21.123+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:21.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:21.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:22.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:22.095+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:22.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:22.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:23.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:23.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:23.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:23.275+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:24.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:24.059+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:24.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:24.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:25.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:25.031+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:25.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:25.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:25.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:25.991+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:26.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:26.223+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:26.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:26.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:27.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:27.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:27.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:27.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:28.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:28.227+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:28.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:28.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:29.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:29.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:29.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:29.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:30.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:30.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:30.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:30.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:31.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:31.271+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:31.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:31.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:32.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:32.287+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:32.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:32.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:33.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:33.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:33.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:33.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:34.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:34.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:34.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:34.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:35.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:35.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:35.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:35.855+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:36.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:36.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:36.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:36.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:37.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:37.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:37.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:37.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:38.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:38.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:38.974 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:38.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:39.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:39.287+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:39.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:39.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:40.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:40.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:41.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:41.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:41.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:41.263+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:42.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:42.027+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:42.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:42.271+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:43.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:43.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:43.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:43.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:44.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:44.122+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:44.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:44.186+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:45.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:45.102+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:45.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:45.234+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:46.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:46.078+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:46.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:46.186+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:47.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:47.090+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:47.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:47.150+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:48.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:48.114+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:48.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:48.130+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:49.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:49.086+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:49.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:49.142+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:50.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:50.074+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:50.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:50.142+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:51.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:51.102+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:51.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:51.190+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:52.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:52.138+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:52.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:52.198+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:53.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:53.158+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:53.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:53.174+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:54.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:54.126+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:54.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:54.182+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:55.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:55.138+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:55.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:55.154+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:56.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:56.142+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:56.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:56.190+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:57.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:57.170+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:57.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:57.206+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:58.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:58.158+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:58.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:58.186+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:59.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:26:59.126+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:26:59.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:26:59.230+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:00.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:00.130+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:00.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:00.270+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:01.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:01.134+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:01.325 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:01.318+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:02.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:02.142+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:02.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:02.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:03.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:03.118+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:03.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:03.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:04.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:04.126+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:04.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:04.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:05.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:05.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:05.413 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:05.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:06.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:06.042+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:06.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:06.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:07.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:07.066+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:07.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:07.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:08.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:08.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:08.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:08.438+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:09.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:09.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:09.412 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:09.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:10.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:10.006+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:10.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:10.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:10.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:10.962+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:11.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:11.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:12.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:12.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:12.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:12.418+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:13.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:13.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:13.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:13.454+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:14.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:14.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:14.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:14.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:15.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:15.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:15.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:15.438+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:16.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:16.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:16.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:16.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:16.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:16.978+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:17.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:17.446+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:18.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:18.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:18.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:18.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:19.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:19.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:19.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:19.382+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:20.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:20.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:20.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:20.414+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:21.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:21.058+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:21.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:21.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:22.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:22.030+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:22.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:22.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:23.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:23.066+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:23.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:23.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:24.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:24.042+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:24.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:24.338+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:25.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:25.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:25.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:25.298+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:26.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:26.042+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:26.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:26.258+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:27.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:27.078+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:27.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:27.278+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:28.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:28.038+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:28.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:28.302+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:29.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:29.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:29.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:29.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:30.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:30.009+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:30.361 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:30.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:30.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:30.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:31.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:31.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:31.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:31.981+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:32.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:32.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:32.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:32.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:33.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:33.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:33.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:33.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:34.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:34.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:34.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:34.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:35.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:35.281+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:35.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:35.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:36.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:36.285+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:36.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:36.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:37.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:37.313+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:37.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:37.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:38.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:38.333+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:38.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:38.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:39.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:39.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:39.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:39.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:40.325 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:40.317+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:40.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:40.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:41.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:41.345+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:41.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:41.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:42.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:42.373+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:42.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:42.941+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:43.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:43.413+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:43.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:43.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:44.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:44.369+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:44.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:44.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:45.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:45.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:45.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:45.917+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:46.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:46.297+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:46.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:46.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:47.266 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:47.257+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:47.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:47.869+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:48.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:48.273+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:48.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:48.877+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:49.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:49.297+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:49.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:49.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:50.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:50.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:50.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:50.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:51.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:51.373+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:51.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:51.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:52.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:52.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:52.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:52.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:53.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:53.317+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:53.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:53.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:54.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:54.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:54.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:54.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:55.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:55.317+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:55.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:55.941+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:56.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:56.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:56.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:56.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:57.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:57.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:58.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:58.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:58.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:58.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:59.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:59.025+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:59.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:27:59.297+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:27:59.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:27:59.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:00.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:00.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:00.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:00.945+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:01.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:01.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:01.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:01.957+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:02.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:02.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:02.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:02.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:03.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:03.381+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:03.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:03.925+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:04.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:04.401+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:04.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:04.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:05.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:05.429+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:05.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:05.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:06.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:06.449+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:06.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:06.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:07.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:07.473+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:07.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:07.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:08.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:08.469+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:08.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:08.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:09.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:09.473+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:09.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:09.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:10.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:10.485+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:10.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:10.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:11.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:11.477+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:11.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:11.885+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:12.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:12.437+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:12.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:12.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:13.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:13.473+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:13.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:13.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:14.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:14.472+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:14.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:14.904+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:15.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:15.480+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:15.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:15.956+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:16.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:16.476+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:16.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:16.980+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:17.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:17.480+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:17.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:17.948+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:18.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:18.432+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:18.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:18.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:19.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:19.420+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:20.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:20.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:20.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:20.432+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:21.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:21.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:21.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:21.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:22.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:22.112+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:22.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:22.440+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:23.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:23.064+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:23.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:23.408+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:24.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:24.100+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:24.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:24.452+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:25.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:25.056+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:25.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:25.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:26.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:26.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:26.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:26.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:27.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:27.064+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:27.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:27.516+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:28.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:28.084+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:28.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:28.536+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:29.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:29.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:29.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:29.512+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:30.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:30.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:30.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:30.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:31.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:31.140+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:31.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:31.552+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:32.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:32.192+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:32.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:32.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:33.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:33.232+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:33.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:33.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:34.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:34.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:34.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:34.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:35.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:35.176+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:35.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:35.620+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:36.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:36.224+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:36.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:36.656+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:37.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:37.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:37.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:37.696+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:38.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:38.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:38.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:38.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:39.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:39.292+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:39.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:39.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:40.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:40.292+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:40.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:40.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:41.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:41.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:41.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:41.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:42.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:42.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:42.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:42.868+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:43.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:43.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:43.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:43.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:44.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:44.280+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:44.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:44.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:45.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:45.304+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:45.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:45.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:46.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:46.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:46.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:46.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:47.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:47.332+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:47.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:47.868+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:48.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:48.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:48.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:48.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:49.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:49.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:49.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:49.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:50.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:50.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:50.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:50.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:51.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:51.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:51.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:51.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:52.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:52.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:52.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:52.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:53.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:53.356+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:53.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:53.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:54.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:54.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:54.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:54.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:55.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:55.348+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:55.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:55.784+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:56.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:56.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:56.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:56.772+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:57.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:57.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:57.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:57.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:58.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:58.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:58.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:58.764+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:59.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:28:59.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:28:59.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:28:59.807+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:00.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:00.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:00.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:00.835+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:01.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:01.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:01.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:01.823+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:02.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:02.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:02.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:02.867+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:03.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:03.223+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:03.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:03.851+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:04.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:04.215+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:04.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:04.851+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:05.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:05.255+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:05.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:05.855+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:06.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:06.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:06.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:06.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:07.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:07.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:07.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:07.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:08.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:08.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:08.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:08.855+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:09.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:09.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:09.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:09.879+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:10.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:10.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:10.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:10.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:11.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:11.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:11.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:11.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:12.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:12.207+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:12.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:12.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:13.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:13.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:13.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:13.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:14.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:14.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:14.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:14.891+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:15.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:15.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:15.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:15.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:16.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:16.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:16.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:16.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:17.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:17.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:18.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:17.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:18.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:18.219+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:19.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:19.031+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:19.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:19.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:20.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:20.051+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:20.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:20.227+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:21.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:21.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:21.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:21.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:22.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:22.051+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:22.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:22.207+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:23.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:23.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:23.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:23.183+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:24.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:24.095+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:24.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:24.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:25.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:25.123+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:25.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:25.163+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:26.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:26.083+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:26.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:26.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:27.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:27.051+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:27.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:27.175+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:28.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:28.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:28.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:28.143+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:29.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:29.035+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:29.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:29.163+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:30.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:29.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:30.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:30.143+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:30.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:30.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:31.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:31.155+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:31.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:31.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:32.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:32.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:32.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:32.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:33.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:33.111+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:34.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:34.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:34.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:34.123+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:35.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:35.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:35.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:35.083+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:36.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:36.039+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:36.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:36.055+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:37.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:37.011+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:37.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:37.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:38.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:38.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:38.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:38.007+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:39.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:39.015+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:39.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:39.031+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:39.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:39.991+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:40.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:39.995+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:41.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:41.019+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:41.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:41.019+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:42.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:42.027+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:42.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:42.043+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:43.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:42.995+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:43.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:42.999+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:43.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:43.970+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:43.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:43.986+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:44.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:44.930+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:44.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:44.986+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:45.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:45.926+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:46.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:46.002+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:46.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:46.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:46.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:46.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:47.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:47.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:47.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:47.958+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:48.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:48.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:48.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:48.914+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:49.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:49.862+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:49.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:49.934+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:50.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:50.866+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:50.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:50.910+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:51.900 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:51.894+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:51.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:51.942+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:52.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:52.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:52.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:52.982+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:53.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:53.866+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:53.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:53.938+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:54.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:54.890+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:54.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:54.986+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:55.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:55.934+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:55.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:55.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:56.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:56.954+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:56.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:56.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:57.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:57.918+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:57.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:57.978+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:58.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:58.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:58.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:58.962+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:29:59.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:29:59.966+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:00.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:29:59.994+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:01.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:01.002+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:01.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:01.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:01.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:01.954+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:02.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:02.006+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:02.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:02.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:03.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:03.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:03.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:03.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:04.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:04.066+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:04.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:04.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:05.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:05.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:05.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:05.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:06.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:06.086+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:07.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:06.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:07.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:07.058+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:08.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:08.014+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:08.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:08.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:09.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:09.010+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:09.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:09.086+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:10.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:10.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:10.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:10.114+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:11.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:11.014+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:11.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:11.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:12.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:11.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:12.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:12.058+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:13.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:13.010+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:13.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:13.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:14.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:14.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:14.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:14.054+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:15.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:14.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:15.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:15.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:16.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:15.998+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:16.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:16.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:16.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:16.962+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:16.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:16.982+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:17.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:17.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:18.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:17.994+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:18.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:18.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:19.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:19.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:19.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:19.914+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:19.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:19.990+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:20.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:20.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:21.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:21.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:22.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:21.998+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:22.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:22.042+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:22.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:22.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:23.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:23.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:23.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:23.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:24.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:24.054+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:24.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:24.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:25.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:25.102+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:25.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:25.910+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:26.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:26.134+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:26.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:26.946+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:27.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:27.170+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:27.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:27.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:28.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:28.154+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:29.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:29.022+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:29.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:29.206+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:30.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:30.070+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:30.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:30.194+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:31.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:31.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:31.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:31.146+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:32.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:32.062+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:32.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:32.162+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:33.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:33.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:33.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:33.190+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:34.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:34.074+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:34.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:34.146+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:35.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:35.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:35.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:35.165+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:36.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:36.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:36.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:36.177+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:37.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:37.001+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:37.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:37.161+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:38.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:38.017+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:38.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:38.113+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:39.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:39.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:39.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:39.069+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:40.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:40.017+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:40.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:40.089+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:40.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:40.977+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:41.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:41.093+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:42.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:42.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:42.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:42.117+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:43.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:43.057+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:43.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:43.085+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:44.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:44.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:44.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:44.093+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:45.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:45.073+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:45.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:45.077+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:46.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:46.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:46.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:46.109+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:47.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:47.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:47.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:47.097+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:48.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:48.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:48.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:48.137+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:49.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:49.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:49.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:49.125+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:50.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:50.037+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:50.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:50.109+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:51.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:51.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:51.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:51.149+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:52.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:52.009+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:52.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:52.113+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:52.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:52.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:53.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:53.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:53.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:53.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:54.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:54.093+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:54.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:54.937+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:55.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:55.097+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:55.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:55.973+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:56.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:56.117+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:57.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:57.013+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:57.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:57.097+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:58.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:58.025+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:58.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:58.137+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:58.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:30:58.989+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:30:59.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:30:59.093+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:00.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:00.013+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:00.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:00.133+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:01.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:01.021+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:01.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:01.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:02.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:02.057+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:02.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:02.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:03.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:03.061+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:03.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:03.081+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:04.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:04.037+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:04.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:04.045+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:05.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:05.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:05.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:05.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:06.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:06.021+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:06.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:06.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:07.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:07.041+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:07.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:07.049+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:08.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:08.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:08.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:08.077+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:08.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:08.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:09.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:09.105+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:09.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:09.957+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:10.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:10.153+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:10.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:10.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:11.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:11.121+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:11.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:11.909+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:12.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:12.137+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:12.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:12.869+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:13.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:13.121+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:13.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:13.873+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:14.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:14.117+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:14.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:14.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:15.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:15.161+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:15.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:15.841+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:16.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:16.165+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:16.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:16.865+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:17.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:17.173+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:17.852 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:17.845+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:18.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:18.181+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:18.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:18.857+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:19.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:19.221+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:19.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:19.861+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:20.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:20.269+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:20.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:20.885+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:21.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:21.269+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:21.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:21.917+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:22.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:22.245+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:22.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:22.917+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:23.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:23.289+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:23.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:23.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:24.325 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:24.321+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:24.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:24.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:25.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:25.285+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:25.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:25.981+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:26.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:26.273+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:27.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:27.024+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:27.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:27.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:28.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:28.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:28.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:28.268+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:29.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:29.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:29.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:29.244+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:30.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:30.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:30.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:30.216+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:31.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:31.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:31.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:31.208+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:32.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:32.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:32.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:32.192+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:33.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:33.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:33.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:33.176+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:34.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:34.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:34.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:34.188+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:35.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:35.100+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:35.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:35.144+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:36.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:36.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:36.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:36.172+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:37.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:37.048+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:37.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:37.168+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:38.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:38.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:38.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:38.208+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:39.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:39.016+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:39.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:39.172+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:39.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:39.980+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:40.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:40.212+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:41.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:41.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:41.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:41.256+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:41.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:41.968+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:42.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:42.284+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:42.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:42.948+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:43.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:43.264+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:43.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:43.900+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:44.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:44.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:44.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:44.952+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:45.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:45.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:45.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:45.976+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:46.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:46.240+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:46.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:46.984+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:47.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:47.268+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:47.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:47.976+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:48.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:48.224+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:48.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:48.968+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:49.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:49.232+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:49.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:49.928+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:50.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:50.232+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:50.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:50.976+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:51.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:51.188+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:52.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:52.016+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:52.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:52.144+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:52.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:52.968+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:53.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:53.176+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:53.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:53.952+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:54.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:54.216+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:54.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:54.928+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:55.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:55.176+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:55.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:55.972+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:56.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:56.192+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:57.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:56.996+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:57.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:57.168+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:58.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:58.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:58.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:58.212+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:59.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:59.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:59.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:31:59.212+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:31:59.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:31:59.976+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:00.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:00.176+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:01.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:00.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:01.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:01.212+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:02.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:02.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:02.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:02.240+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:03.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:03.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:03.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:03.244+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:04.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:04.012+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:04.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:04.216+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:05.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:05.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:05.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:05.200+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:06.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:06.012+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:06.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:06.204+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:07.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:07.032+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:07.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:07.200+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:08.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:08.060+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:08.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:08.180+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:09.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:09.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:09.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:09.216+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:10.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:10.036+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:10.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:10.200+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:11.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:11.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:11.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:11.164+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:12.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:12.060+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:12.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:12.180+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:13.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:13.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:13.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:13.204+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:14.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:14.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:14.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:14.248+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:15.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:15.064+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:15.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:15.244+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:16.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:16.100+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:16.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:16.275+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:17.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:17.075+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:17.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:17.243+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:18.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:18.075+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:18.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:18.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:19.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:19.111+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:19.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:19.283+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:20.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:20.119+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:20.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:20.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:21.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:21.123+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:21.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:21.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:22.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:22.143+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:22.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:22.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:23.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:23.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:23.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:23.251+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:24.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:24.147+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:24.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:24.287+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:25.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:25.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:25.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:25.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:26.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:26.155+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:26.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:26.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:27.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:27.159+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:27.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:27.259+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:28.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:28.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:28.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:28.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:29.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:29.191+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:29.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:29.283+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:30.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:30.183+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:30.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:30.259+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:31.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:31.151+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:31.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:31.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:32.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:32.191+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:32.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:32.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:33.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:33.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:33.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:33.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:34.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:34.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:34.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:34.303+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:35.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:35.147+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:35.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:35.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:36.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:36.151+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:36.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:36.319+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:37.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:37.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:37.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:37.327+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:38.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:38.171+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:38.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:38.363+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:39.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:39.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:39.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:39.407+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:40.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:40.171+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:40.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:40.419+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:41.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:41.191+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:41.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:41.447+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:42.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:42.155+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:42.491 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:42.483+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:43.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:43.175+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:43.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:43.479+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:44.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:44.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:44.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:44.503+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:45.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:45.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:45.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:45.515+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:46.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:46.247+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:46.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:46.515+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:47.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:47.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:47.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:47.511+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:48.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:48.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:48.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:48.515+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:49.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:49.247+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:49.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:49.491+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:50.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:50.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:50.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:50.471+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:51.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:51.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:51.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:51.475+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:52.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:52.255+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:52.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:52.475+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:53.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:53.271+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:53.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:53.427+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:54.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:54.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:54.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:54.399+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:55.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:55.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:55.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:55.383+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:56.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:56.367+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:56.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:56.435+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:57.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:57.375+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:57.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:57.419+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:58.379 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:58.371+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:58.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:58.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:59.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:32:59.371+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:32:59.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:32:59.439+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:00.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:00.375+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:00.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:00.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:01.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:01.335+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:01.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:01.463+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:02.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:02.347+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:02.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:02.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:03.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:03.331+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:03.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:03.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:04.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:04.323+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:04.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:04.435+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:05.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:05.322+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:05.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:05.434+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:06.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:06.302+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:06.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:06.462+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:07.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:07.326+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:07.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:07.474+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:08.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:08.370+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:08.509 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:08.502+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:09.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:09.414+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:09.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:09.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:10.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:10.382+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:10.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:10.498+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:11.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:11.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:11.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:11.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:12.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:12.450+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:12.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:12.458+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:13.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:13.458+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:13.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:13.474+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:14.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:14.474+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:14.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:14.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:15.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:15.474+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:15.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:15.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:16.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:16.466+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:16.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:16.514+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:17.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:17.486+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:17.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:17.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:18.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:18.490+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:18.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:18.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:19.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:19.526+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:19.560 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:19.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:20.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:20.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:20.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:20.578+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:21.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:21.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:21.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:21.574+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:22.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:22.534+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:22.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:22.578+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:23.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:23.522+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:23.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:23.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:24.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:24.494+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:24.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:24.502+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:25.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:25.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:25.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:25.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:26.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:26.522+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:26.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:26.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:27.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:27.478+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:27.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:27.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:28.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:28.486+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:28.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:28.594+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:29.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:29.474+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:29.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:29.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:30.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:30.438+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:30.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:30.534+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:31.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:31.390+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:31.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:31.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:32.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:32.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:32.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:32.534+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:33.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:33.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:33.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:33.494+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:34.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:34.454+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:34.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:34.502+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:35.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:35.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:35.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:35.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:36.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:36.450+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:36.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:36.534+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:37.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:37.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:37.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:37.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:38.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:38.462+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:38.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:38.570+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:39.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:39.458+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:39.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:39.594+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:40.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:40.470+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:40.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:40.594+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:41.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:41.502+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:41.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:41.590+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:42.491 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:42.482+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:42.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:42.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:43.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:43.522+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:43.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:43.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:44.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:44.482+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:44.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:44.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:45.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:45.462+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:45.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:45.678+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:46.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:46.478+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:46.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:46.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:47.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:47.470+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:47.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:47.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:48.454 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:48.446+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:48.596 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:48.590+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:49.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:49.438+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:49.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:49.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:50.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:50.466+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:50.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:50.650+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:51.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:51.430+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:51.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:51.698+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:52.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:52.458+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:52.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:52.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:53.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:53.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:53.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:53.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:54.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:54.378+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:54.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:54.594+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:55.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:55.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:55.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:55.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:56.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:56.414+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:56.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:56.546+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:57.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:57.414+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:57.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:57.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:58.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:58.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:58.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:58.526+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:59.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:33:59.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:33:59.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:33:59.514+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:00.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:00.390+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:00.494 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:00.486+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:01.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:01.354+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:01.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:01.513+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:02.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:02.349+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:02.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:02.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:03.350 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:03.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:03.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:03.429+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:04.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:04.389+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:04.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:04.409+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:05.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:05.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:05.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:05.413+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:06.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:06.365+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:06.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:06.397+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:07.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:07.381+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:07.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:07.429+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:08.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:08.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:08.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:08.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:09.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:09.309+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:09.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:09.473+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:10.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:10.273+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:10.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:10.489+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:11.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:11.301+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:11.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:11.481+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:12.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:12.273+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:12.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:12.449+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:13.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:13.305+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:13.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:13.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:14.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:14.297+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:14.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:14.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:15.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:15.333+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:15.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:15.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:16.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:16.373+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:16.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:16.449+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:17.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:17.329+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:17.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:17.421+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:18.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:18.341+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:18.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:18.393+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:19.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:19.313+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:19.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:19.385+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:20.358 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:20.349+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:20.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:20.421+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:21.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:21.365+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:21.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:21.385+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:22.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:22.325+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:22.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:22.377+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:23.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:23.365+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:23.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:23.373+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:24.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:24.341+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:24.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:24.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:25.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:25.333+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:25.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:25.397+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:26.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:26.345+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:26.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:26.369+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:27.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:27.321+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:27.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:27.373+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:28.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:28.345+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:28.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:28.357+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:29.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:29.337+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:29.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:29.393+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:30.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:30.365+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:30.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:30.385+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:31.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:31.321+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:31.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:31.369+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:32.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:32.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:32.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:32.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:33.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:33.281+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:33.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:33.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:34.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:34.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:34.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:34.381+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:35.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:35.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:35.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:35.337+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:36.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:36.265+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:36.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:36.305+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:37.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:37.301+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:37.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:37.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:38.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:38.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:38.361 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:38.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:39.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:39.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:39.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:39.345+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:40.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:40.253+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:40.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:40.345+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:41.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:41.249+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:41.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:41.353+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:42.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:42.289+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:42.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:42.401+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:43.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:43.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:43.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:43.413+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:44.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:44.305+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:44.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:44.465+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:45.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:45.329+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:45.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:45.453+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:46.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:46.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:46.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:46.477+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:47.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:47.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:47.464 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:47.457+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:48.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:48.265+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:48.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:48.481+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:49.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:49.245+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:49.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:49.493+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:50.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:50.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:50.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:50.445+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:51.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:51.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:51.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:51.433+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:52.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:52.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:52.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:52.421+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:53.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:53.225+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:53.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:53.409+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:54.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:54.209+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:54.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:54.377+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:55.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:55.221+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:55.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:55.429+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:56.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:56.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:56.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:56.461+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:57.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:57.265+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:57.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:57.465+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:58.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:58.296+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:58.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:58.476+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:59.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:34:59.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:34:59.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:34:59.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:00.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:00.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:00.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:00.484+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:01.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:01.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:01.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:01.508+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:02.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:02.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:02.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:02.516+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:03.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:03.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:03.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:03.472+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:04.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:04.208+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:04.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:04.436+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:05.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:05.184+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:05.409 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:05.404+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:06.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:06.216+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:06.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:06.364+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:07.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:07.172+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:07.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:07.380+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:08.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:08.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:08.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:08.384+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:09.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:09.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:09.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:09.420+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:10.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:10.144+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:10.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:10.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:11.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:11.196+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:11.423 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:11.416+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:12.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:12.184+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:12.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:12.412+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:13.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:13.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:13.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:13.396+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:14.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:14.172+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:14.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:14.412+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:15.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:15.208+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:15.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:15.448+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:16.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:16.232+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:16.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:16.456+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:17.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:17.228+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:17.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:17.488+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:18.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:18.232+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:18.454 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:18.448+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:19.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:19.184+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:19.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:19.492+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:20.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:20.172+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:20.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:20.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:21.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:21.192+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:21.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:21.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:22.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:22.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:22.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:22.608+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:23.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:23.204+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:23.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:23.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:24.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:24.224+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:24.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:24.632+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:25.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:25.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:25.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:25.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:26.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:26.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:26.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:26.644+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:27.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:27.320+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:27.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:27.600+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:28.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:28.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:28.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:28.600+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:29.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:29.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:29.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:29.552+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:30.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:30.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:30.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:30.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:31.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:31.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:31.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:31.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:32.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:32.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:32.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:32.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:33.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:33.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:33.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:33.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:34.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:34.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:34.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:34.644+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:35.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:35.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:35.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:35.696+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:36.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:36.280+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:36.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:36.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:37.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:37.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:37.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:37.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:38.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:38.312+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:38.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:38.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:39.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:39.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:39.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:39.684+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:40.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:40.228+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:40.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:40.656+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:41.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:41.204+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:41.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:41.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:42.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:42.252+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:42.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:42.632+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:43.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:43.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:43.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:43.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:44.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:44.196+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:44.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:44.668+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:45.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:45.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:45.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:45.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:46.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:46.240+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:46.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:46.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:47.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:47.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:47.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:47.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:48.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:48.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:48.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:48.732+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:49.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:49.324+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:49.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:49.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:50.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:50.372+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:50.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:50.704+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:51.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:51.420+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:51.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:51.732+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:52.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:52.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:52.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:52.715+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:53.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:53.387+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:53.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:53.723+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:54.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:54.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:54.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:54.723+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:55.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:55.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:55.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:55.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:56.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:56.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:56.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:56.795+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:57.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:57.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:57.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:57.823+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:58.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:58.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:58.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:58.803+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:59.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:35:59.379+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:35:59.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:35:59.807+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:00.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:00.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:00.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:00.775+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:01.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:01.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:01.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:01.755+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:02.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:02.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:02.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:02.731+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:03.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:03.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:03.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:03.767+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:04.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:04.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:04.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:04.771+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:05.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:05.383+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:05.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:05.755+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:06.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:06.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:06.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:06.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:07.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:07.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:07.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:07.751+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:08.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:08.271+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:08.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:08.803+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:09.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:09.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:09.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:09.851+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:10.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:10.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:10.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:10.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:11.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:11.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:11.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:11.847+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:12.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:12.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:12.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:12.811+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:13.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:13.323+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:13.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:13.851+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:14.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:14.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:14.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:14.891+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:15.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:15.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:15.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:15.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:16.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:16.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:16.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:16.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:17.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:17.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:17.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:17.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:18.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:18.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:18.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:18.975+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:19.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:19.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:20.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:20.003+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:20.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:20.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:21.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:21.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:21.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:21.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:22.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:21.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:22.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:22.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:23.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:23.027+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:23.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:23.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:24.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:24.027+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:24.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:24.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:24.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:24.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:25.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:25.375+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:25.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:25.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:26.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:26.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:27.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:27.003+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:27.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:27.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:27.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:27.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:28.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:28.423+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:29.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:28.995+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:29.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:29.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:29.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:29.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:30.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:30.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:30.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:30.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:31.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:31.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:31.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:31.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:32.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:32.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:32.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:32.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:33.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:33.487+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:33.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:33.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:34.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:34.511+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:34.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:34.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:35.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:35.543+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:35.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:35.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:36.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:36.583+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:36.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:36.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:37.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:37.627+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:37.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:37.939+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:38.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:38.651+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:38.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:38.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:39.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:39.695+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:39.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:39.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:40.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:40.699+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:40.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:40.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:41.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:41.695+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:41.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:41.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:42.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:42.647+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:42.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:42.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:43.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:43.623+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:43.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:43.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:44.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:44.643+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:44.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:44.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:45.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:45.599+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:45.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:45.906+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:46.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:46.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:46.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:46.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:47.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:47.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:47.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:47.958+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:48.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:48.570+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:48.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:48.978+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:49.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:49.526+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:49.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:49.938+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:50.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:50.482+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:50.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:50.966+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:51.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:51.458+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:52.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:52.002+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:52.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:52.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:53.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:53.022+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:53.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:53.474+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:53.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:53.982+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:54.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:54.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:55.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:55.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:55.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:55.454+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:55.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:55.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:56.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:56.458+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:56.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:56.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:57.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:57.502+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:57.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:57.958+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:58.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:58.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:58.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:58.930+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:59.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:36:59.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:36:59.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:36:59.982+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:00.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:00.458+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:01.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:01.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:01.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:01.438+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:02.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:02.062+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:02.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:02.482+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:03.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:03.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:03.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:03.526+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:03.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:03.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:04.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:04.578+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:04.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:04.986+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:05.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:05.530+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:06.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:06.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:06.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:06.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:07.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:07.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:07.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:07.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:08.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:08.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:08.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:08.566+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:09.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:09.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:09.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:09.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:10.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:10.010+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:10.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:10.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:11.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:11.010+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:11.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:11.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:11.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:11.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:12.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:12.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:13.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:12.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:13.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:13.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:13.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:13.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:14.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:14.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:14.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:14.946+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:15.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:15.558+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:15.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:15.966+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:16.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:16.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:16.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:16.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:17.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:17.586+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:17.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:17.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:18.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:18.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:18.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:18.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:19.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:19.554+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:19.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:19.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:20.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:20.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:20.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:20.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:21.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:21.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:21.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:21.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:22.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:22.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:22.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:22.914+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:23.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:23.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:23.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:23.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:24.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:24.578+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:24.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:24.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:25.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:25.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:25.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:25.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:26.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:26.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:26.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:26.966+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:27.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:27.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:28.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:28.014+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:28.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:28.546+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:29.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:29.042+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:29.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:29.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:30.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:29.998+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:30.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:30.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:31.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:31.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:31.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:31.534+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:32.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:32.022+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:32.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:32.526+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:33.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:33.070+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:33.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:33.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:34.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:34.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:34.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:34.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:35.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:35.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:35.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:35.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:36.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:36.002+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:36.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:36.514+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:37.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:37.042+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:37.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:37.518+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:38.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:38.046+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:38.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:38.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:39.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:39.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:39.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:39.518+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:40.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:40.142+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:40.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:40.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:41.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:41.098+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:41.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:41.434+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:42.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:42.070+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:42.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:42.430+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:43.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:43.054+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:43.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:43.434+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:44.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:44.014+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:44.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:44.482+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:44.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:44.978+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:45.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:45.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:46.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:46.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:46.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:46.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:47.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:47.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:47.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:47.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:48.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:48.078+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:48.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:48.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:49.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:49.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:49.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:49.482+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:50.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:50.118+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:50.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:50.493+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:51.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:51.097+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:51.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:51.481+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:52.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:52.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:52.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:52.477+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:53.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:53.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:53.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:53.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:54.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:54.045+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:54.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:54.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:55.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:55.025+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:55.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:55.533+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:56.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:56.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:56.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:56.565+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:57.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:57.117+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:57.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:57.565+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:58.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:58.097+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:58.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:58.613+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:59.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:37:59.117+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:37:59.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:37:59.577+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:00.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:00.169+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:00.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:00.613+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:01.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:01.145+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:01.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:01.657+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:02.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:02.185+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:02.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:02.677+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:03.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:03.157+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:03.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:03.665+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:04.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:04.137+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:04.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:04.713+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:05.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:05.101+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:05.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:05.669+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:06.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:06.077+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:06.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:06.661+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:07.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:07.061+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:07.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:07.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:08.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:08.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:08.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:08.625+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:09.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:09.041+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:09.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:09.629+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:10.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:10.009+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:10.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:10.597+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:11.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:11.021+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:11.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:11.637+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:12.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:12.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:12.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:12.653+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:13.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:13.045+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:13.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:13.617+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:14.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:14.001+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:14.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:14.577+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:15.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:15.017+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:15.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:15.565+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:16.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:16.053+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:16.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:16.557+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:17.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:17.053+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:17.588 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:17.581+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:18.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:18.041+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:18.611 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:18.601+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:19.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:19.085+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:19.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:19.653+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:20.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:20.069+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:20.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:20.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:21.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:21.045+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:21.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:21.685+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:22.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:22.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:22.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:22.725+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:22.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:22.969+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:23.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:23.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:23.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:23.957+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:24.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:24.741+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:24.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:24.913+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:25.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:25.785+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:25.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:25.953+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:26.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:26.813+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:26.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:26.969+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:27.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:27.817+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:27.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:27.941+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:28.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:28.833+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:28.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:28.973+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:29.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:29.809+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:29.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:29.973+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:30.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:30.785+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:30.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:30.933+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:31.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:31.829+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:31.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:31.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:32.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:32.841+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:32.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:32.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:33.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:33.857+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:33.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:33.869+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:34.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:34.857+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:34.892 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:34.885+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:35.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:35.841+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:35.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:35.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:36.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:36.869+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:36.878 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:36.869+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:37.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:37.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:37.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:37.901+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:38.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:38.837+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:38.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:38.921+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:39.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:39.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:39.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:39.917+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:40.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:40.785+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:40.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:40.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:41.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:41.781+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:41.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:41.909+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:42.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:42.745+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:42.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:42.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:43.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:43.781+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:43.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:43.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:44.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:44.829+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:44.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:44.845+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:45.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:45.789+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:45.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:45.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:46.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:46.777+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:46.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:46.801+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:47.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:47.765+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:47.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:47.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:48.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:48.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:48.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:48.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:49.733 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:49.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:49.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:49.744+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:50.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:50.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:50.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:50.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:51.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:51.720+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:51.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:51.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:52.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:52.684+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:52.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:52.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:53.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:53.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:53.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:53.700+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:54.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:54.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:54.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:54.676+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:55.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:55.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:55.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:55.724+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:56.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:56.628+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:56.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:56.688+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:57.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:57.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:57.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:57.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:58.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:58.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:58.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:58.720+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:59.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:38:59.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:38:59.775 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:38:59.768+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:00.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:00.684+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:00.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:00.792+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:01.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:01.704+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:01.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:01.784+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:02.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:02.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:02.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:02.764+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:03.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:03.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:03.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:03.720+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:04.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:04.684+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:04.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:04.760+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:05.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:05.668+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:05.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:05.748+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:06.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:06.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:06.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:06.784+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:07.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:07.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:07.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:07.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:08.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:08.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:08.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:08.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:09.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:09.512+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:09.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:09.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:10.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:10.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:10.733 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:10.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:11.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:11.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:11.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:11.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:12.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:12.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:12.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:12.704+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:13.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:13.536+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:13.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:13.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:14.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:14.536+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:14.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:14.724+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:15.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:15.492+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:15.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:15.680+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:16.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:16.480+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:16.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:16.692+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:17.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:17.464+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:17.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:17.696+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:18.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:18.460+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:18.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:18.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:19.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:19.500+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:19.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:19.752+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:20.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:20.512+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:20.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:20.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:21.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:21.472+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:21.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:21.720+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:22.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:22.492+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:22.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:22.692+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:23.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:23.512+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:23.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:23.740+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:24.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:24.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:24.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:24.752+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:25.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:25.588+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:25.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:25.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:26.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:26.572+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:26.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:26.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:27.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:27.552+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:27.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:27.792+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:28.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:28.568+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:28.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:28.784+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:29.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:29.600+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:29.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:29.816+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:30.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:30.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:30.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:30.780+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:31.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:31.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:31.800 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:31.796+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:32.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:32.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:32.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:32.784+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:33.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:33.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:33.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:33.816+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:34.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:34.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:34.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:34.780+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:35.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:35.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:35.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:35.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:36.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:36.720+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:36.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:36.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:37.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:37.700+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:37.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:37.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:38.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:38.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:38.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:38.736+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:39.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:39.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:39.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:39.756+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:40.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:40.712+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:40.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:40.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:41.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:41.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:41.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:41.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:42.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:42.688+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:42.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:42.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:43.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:43.704+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:43.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:43.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:44.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:44.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:44.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:44.684+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:45.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:45.631+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:45.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:45.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:46.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:46.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:46.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:46.667+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:47.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:47.619+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:47.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:47.623+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:48.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:48.595+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:48.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:48.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:49.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:49.563+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:49.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:49.643+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:50.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:50.599+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:50.659 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:50.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:51.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:51.631+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:51.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:51.691+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:52.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:52.607+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:52.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:52.659+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:53.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:53.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:53.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:53.671+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:54.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:54.655+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:54.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:54.703+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:55.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:55.647+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:55.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:55.715+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:56.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:56.683+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:56.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:56.743+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:57.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:57.671+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:57.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:57.743+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:58.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:58.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:58.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:58.779+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:59.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:39:59.659+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:39:59.775 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:39:59.771+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:00.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:00.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:00.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:00.771+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:01.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:01.595+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:01.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:01.791+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:02.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:02.583+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:02.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:02.843+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:03.574 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:03.567+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:03.895 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:03.891+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:04.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:04.547+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:04.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:04.931+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:05.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:05.535+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:05.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:05.975+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:06.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:06.563+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:06.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:06.987+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:07.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:07.579+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:07.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:07.979+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:08.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:08.555+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:08.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:08.975+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:09.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:09.559+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:09.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:09.959+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:10.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:10.523+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:10.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:10.935+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:11.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:11.539+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:11.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:11.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:12.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:12.567+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:12.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:12.895+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:13.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:13.527+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:13.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:13.851+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:14.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:14.511+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:14.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:14.883+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:15.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:15.531+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:15.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:15.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:16.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:16.511+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:16.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:16.915+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:17.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:17.467+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:17.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:17.923+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:18.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:18.503+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:18.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:18.895+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:19.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:19.555+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:19.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:19.871+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:20.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:20.595+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:20.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:20.871+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:21.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:21.559+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:21.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:21.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:22.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:22.579+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:22.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:22.847+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:23.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:23.555+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:23.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:23.851+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:24.585 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:24.579+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:24.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:24.819+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:25.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:25.579+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:25.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:25.839+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:26.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:26.551+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:26.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:26.887+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:27.510 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:27.503+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:27.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:27.911+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:28.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:28.515+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:28.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:28.951+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:29.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:29.563+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:29.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:29.947+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:30.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:30.603+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:30.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:30.947+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:31.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:31.555+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:31.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:31.955+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:32.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:32.527+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:32.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:32.951+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:33.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:33.527+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:33.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:33.927+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:34.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:34.535+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:34.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:34.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:35.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:35.535+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:35.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:35.927+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:36.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:36.559+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:36.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:36.951+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:37.585 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:37.579+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:37.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:37.951+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:38.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:38.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:38.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:38.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:39.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:39.522+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:39.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:39.938+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:40.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:40.490+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:40.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:40.894+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:41.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:41.450+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:41.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:41.850+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:42.486 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:42.478+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:42.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:42.858+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:43.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:43.514+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:43.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:43.894+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:44.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:44.518+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:44.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:44.846+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:45.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:45.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:45.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:45.858+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:46.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:46.514+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:46.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:46.906+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:47.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:47.534+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:47.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:47.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:48.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:48.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:48.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:48.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:49.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:49.538+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:49.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:49.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:50.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:50.502+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:50.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:50.842+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:51.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:51.490+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:51.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:51.810+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:52.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:52.530+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:52.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:52.818+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:53.527 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:53.518+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:53.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:53.854+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:54.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:54.518+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:54.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:54.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:55.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:55.550+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:55.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:55.826+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:56.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:56.510+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:56.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:56.794+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:57.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:57.546+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:57.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:57.810+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:58.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:58.586+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:58.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:58.778+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:59.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:40:59.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:40:59.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:40:59.742+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:00.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:00.570+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:00.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:00.790+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:01.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:01.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:01.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:01.798+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:02.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:02.598+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:02.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:02.826+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:03.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:03.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:03.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:03.806+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:04.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:04.582+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:04.800 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:04.794+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:05.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:05.614+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:05.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:05.818+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:06.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:06.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:06.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:06.842+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:07.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:07.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:07.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:07.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:08.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:08.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:08.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:08.838+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:09.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:09.794+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:09.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:09.794+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:10.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:10.774+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:10.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:10.798+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:11.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:11.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:11.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:11.774+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:12.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:12.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:12.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:12.762+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:13.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:13.722+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:13.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:13.770+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:14.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:14.754+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:14.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:14.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:15.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:15.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:15.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:15.766+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:16.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:16.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:16.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:16.806+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:17.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:17.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:17.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:17.782+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:18.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:18.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:18.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:18.762+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:19.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:19.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:19.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:19.726+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:20.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:20.750+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:20.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:20.758+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:21.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:21.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:21.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:21.762+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:22.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:22.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:22.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:22.798+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:23.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:23.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:23.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:23.850+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:24.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:24.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:24.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:24.858+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:25.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:25.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:25.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:25.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:26.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:26.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:26.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:26.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:27.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:27.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:27.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:27.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:28.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:28.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:28.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:28.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:29.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:29.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:29.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:29.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:30.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:30.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:30.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:30.866+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:31.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:31.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:31.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:31.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:32.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:32.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:32.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:32.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:33.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:33.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:33.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:33.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:34.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:34.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:34.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:34.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:35.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:35.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:35.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:35.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:36.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:36.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:36.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:36.877+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:37.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:37.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:37.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:37.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:38.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:38.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:38.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:38.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:39.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:39.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:39.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:39.973+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:40.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:40.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:41.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:40.993+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:41.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:41.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:41.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:41.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:42.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:42.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:42.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:42.917+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:43.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:43.865+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:43.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:43.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:44.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:44.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:44.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:44.901+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:45.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:45.873+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:45.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:45.901+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:46.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:46.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:46.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:46.937+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:47.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:47.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:47.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:47.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:48.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:48.877+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:48.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:48.937+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:49.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:49.861+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:49.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:49.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:50.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:50.905+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:50.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:50.909+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:51.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:51.897+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:51.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:51.917+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:52.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:52.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:52.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:52.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:53.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:53.873+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:53.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:53.941+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:54.858 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:54.849+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:54.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:54.917+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:55.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:55.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:55.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:55.957+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:56.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:56.833+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:56.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:56.965+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:57.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:57.873+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:57.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:57.937+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:58.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:58.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:58.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:58.953+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:59.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:41:59.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:41:59.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:41:59.913+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:00.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:00.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:00.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:00.937+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:01.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:01.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:01.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:01.913+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:02.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:02.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:02.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:02.869+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:03.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:03.805+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:03.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:03.921+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:04.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:04.773+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:04.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:04.901+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:05.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:05.765+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:05.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:05.949+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:06.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:06.765+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:06.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:06.921+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:07.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:07.761+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:07.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:07.877+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:08.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:08.741+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:08.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:08.865+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:09.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:09.745+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:09.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:09.841+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:10.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:10.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:10.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:10.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:11.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:11.777+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:11.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:11.809+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:12.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:12.765+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:12.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:12.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:13.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:13.761+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:13.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:13.801+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:14.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:14.733+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:14.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:14.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:15.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:15.717+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:15.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:15.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:16.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:16.685+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:16.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:16.689+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:17.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:17.657+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:17.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:17.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:18.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:18.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:18.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:18.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:19.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:19.673+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:19.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:19.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:20.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:20.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:20.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:20.721+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:21.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:21.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:21.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:21.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:22.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:22.585+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:22.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:22.805+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:23.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:23.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:23.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:23.837+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:24.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:24.593+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:24.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:24.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:25.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:25.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:25.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:25.749+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:26.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:26.561+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:26.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:26.773+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:27.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:27.565+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:27.824 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:27.821+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:28.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:28.553+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:28.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:28.781+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:29.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:29.541+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:29.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:29.809+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:30.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:30.565+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:30.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:30.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:31.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:31.521+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:31.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:31.801+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:32.527 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:32.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:32.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:32.784+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:33.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:33.548+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:33.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:33.748+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:34.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:34.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:34.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:34.712+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:35.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:35.624+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:35.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:35.724+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:36.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:36.584+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:36.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:36.772+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:37.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:37.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:37.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:37.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:38.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:38.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:38.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:38.832+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:39.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:39.548+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:39.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:39.812+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:40.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:40.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:40.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:40.792+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:41.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:41.528+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:41.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:41.836+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:42.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:42.544+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:42.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:42.812+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:43.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:43.520+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:43.821 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:43.816+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:44.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:44.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:44.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:44.860+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:45.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:45.520+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:45.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:45.884+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:46.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:46.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:46.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:46.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:47.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:47.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:47.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:47.892+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:48.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:48.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:48.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:48.908+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:49.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:49.600+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:49.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:49.952+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:50.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:50.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:50.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:50.932+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:51.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:51.620+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:51.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:51.944+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:52.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:52.668+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:52.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:52.932+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:53.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:53.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:53.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:53.940+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:54.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:54.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:54.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:54.984+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:55.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:55.720+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:56.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:56.012+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:56.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:56.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:57.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:57.004+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:57.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:57.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:58.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:58.004+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:58.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:58.760+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:58.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:42:58.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:42:59.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:42:59.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:00.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:00.012+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:00.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:00.784+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:01.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:01.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:01.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:01.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:02.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:02.072+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:02.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:02.796+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:03.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:03.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:03.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:03.808+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:04.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:04.108+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:04.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:04.764+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:05.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:05.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:05.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:05.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:06.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:06.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:06.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:06.804+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:07.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:07.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:07.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:07.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:08.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:08.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:08.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:08.872+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:09.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:09.160+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:09.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:09.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:10.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:10.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:10.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:10.916+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:11.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:11.144+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:11.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:11.940+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:12.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:12.152+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:12.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:12.972+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:13.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:13.120+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:13.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:13.976+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:14.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:14.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:14.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:14.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:15.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:15.120+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:15.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:15.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:16.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:16.152+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:16.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:16.868+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:17.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:17.128+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:17.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:17.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:18.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:18.140+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:18.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:18.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:19.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:19.192+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:19.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:19.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:20.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:20.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:20.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:20.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:21.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:21.244+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:21.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:21.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:22.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:22.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:22.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:22.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:23.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:23.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:23.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:23.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:24.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:24.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:24.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:24.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:25.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:25.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:25.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:25.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:26.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:26.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:26.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:26.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:27.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:27.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:27.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:27.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:28.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:28.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:28.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:28.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:29.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:29.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:29.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:29.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:30.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:30.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:30.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:30.879+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:31.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:31.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:31.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:31.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:32.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:32.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:32.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:32.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:33.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:33.267+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:33.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:33.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:34.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:34.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:34.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:34.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:35.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:35.251+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:35.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:35.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:36.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:36.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:36.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:36.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:37.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:37.255+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:37.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:37.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:38.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:38.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:38.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:38.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:39.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:39.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:39.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:39.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:40.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:40.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:40.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:40.887+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:41.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:41.375+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:41.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:41.863+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:42.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:42.351+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:42.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:42.819+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:43.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:43.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:43.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:43.827+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:44.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:44.335+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:44.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:44.867+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:45.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:45.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:45.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:45.879+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:46.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:46.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:46.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:46.859+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:47.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:47.407+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:47.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:47.819+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:48.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:48.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:48.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:48.835+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:49.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:49.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:49.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:49.799+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:50.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:50.423+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:50.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:50.755+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:51.471 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:51.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:51.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:51.723+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:52.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:52.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:52.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:52.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:53.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:53.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:53.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:53.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:54.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:54.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:54.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:54.739+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:55.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:55.387+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:55.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:55.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:56.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:56.431+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:56.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:56.759+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:57.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:57.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:57.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:57.735+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:58.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:58.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:58.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:58.723+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:59.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:43:59.463+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:43:59.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:43:59.751+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:00.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:00.475+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:00.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:00.735+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:01.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:01.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:01.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:01.771+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:02.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:02.527+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:02.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:02.783+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:03.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:03.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:03.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:03.771+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:04.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:04.543+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:04.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:04.735+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:05.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:05.495+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:05.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:05.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:06.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:06.499+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:06.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:06.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:07.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:07.543+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:07.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:07.755+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:08.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:08.503+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:08.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:08.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:09.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:09.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:09.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:09.751+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:10.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:10.523+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:10.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:10.715+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:11.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:11.567+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:11.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:11.675+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:12.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:12.547+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:12.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:12.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:13.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:13.531+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:13.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:13.667+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:14.538 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:14.531+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:14.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:14.675+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:15.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:15.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:15.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:15.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:16.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:16.627+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:16.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:16.671+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:17.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:17.659+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:17.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:17.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:18.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:18.623+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:18.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:18.711+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:19.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:19.607+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:19.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:19.683+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:20.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:20.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:20.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:20.722+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:21.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:21.526+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:21.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:21.694+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:22.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:22.558+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:22.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:22.742+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:23.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:23.610+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:23.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:23.710+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:24.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:24.602+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:24.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:24.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:25.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:25.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:25.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:25.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:26.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:26.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:26.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:26.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:27.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:27.598+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:27.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:27.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:28.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:28.614+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:28.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:28.634+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:29.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:29.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:29.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:29.682+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:30.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:30.602+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:30.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:30.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:31.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:31.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:31.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:31.694+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:32.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:32.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:32.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:32.726+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:33.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:33.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:33.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:33.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:34.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:34.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:34.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:34.710+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:35.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:35.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:35.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:35.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:36.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:36.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:36.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:36.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:37.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:37.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:37.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:37.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:38.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:38.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:38.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:38.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:39.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:39.650+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:39.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:39.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:40.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:40.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:40.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:40.738+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:41.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:41.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:41.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:41.694+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:42.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:42.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:42.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:42.718+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:43.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:43.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:43.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:43.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:44.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:44.690+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:44.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:44.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:45.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:45.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:45.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:45.726+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:46.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:46.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:46.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:46.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:47.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:47.706+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:47.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:47.746+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:48.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:48.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:48.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:48.778+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:49.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:49.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:49.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:49.822+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:50.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:50.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:50.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:50.826+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:51.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:51.674+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:51.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:51.814+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:52.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:52.710+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:52.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:52.818+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:53.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:53.742+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:53.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:53.814+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:54.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:54.698+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:54.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:54.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:55.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:55.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:55.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:55.818+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:56.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:56.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:56.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:56.770+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:57.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:57.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:57.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:57.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:58.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:58.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:58.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:58.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:59.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:44:59.690+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:44:59.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:44:59.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:00.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:00.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:00.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:00.718+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:01.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:01.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:01.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:01.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:02.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:02.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:02.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:02.742+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:03.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:03.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:03.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:03.786+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:04.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:04.646+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:04.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:04.802+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:05.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:05.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:05.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:05.770+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:06.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:06.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:06.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:06.738+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:07.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:07.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:07.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:07.714+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:08.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:08.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:08.753 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:08.746+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:09.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:09.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:09.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:09.754+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:10.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:10.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:10.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:10.802+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:11.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:11.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:11.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:11.785+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:12.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:12.637+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:12.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:12.773+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:13.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:13.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:13.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:13.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:14.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:14.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:14.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:14.809+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:15.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:15.661+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:15.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:15.777+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:16.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:16.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:16.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:16.761+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:17.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:17.669+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:17.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:17.793+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:18.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:18.717+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:18.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:18.833+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:19.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:19.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:19.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:19.813+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:20.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:20.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:20.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:20.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:21.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:21.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:21.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:21.813+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:22.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:22.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:22.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:22.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:23.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:23.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:23.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:23.817+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:24.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:24.757+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:24.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:24.805+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:25.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:25.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:25.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:25.833+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:26.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:26.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:26.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:26.873+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:27.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:27.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:27.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:27.857+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:28.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:28.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:28.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:28.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:29.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:29.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:29.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:29.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:30.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:30.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:30.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:30.945+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:31.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:31.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:31.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:31.973+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:32.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:32.757+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:32.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:32.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:33.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:33.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:33.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:33.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:34.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:34.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:34.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:34.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:35.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:35.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:35.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:35.909+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:36.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:36.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:36.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:36.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:37.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:37.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:37.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:37.849+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:38.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:38.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:38.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:38.805+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:39.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:39.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:39.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:39.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:40.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:40.773+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:40.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:40.825+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:41.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:41.809+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:41.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:41.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:42.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:42.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:42.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:42.817+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:43.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:43.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:43.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:43.837+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:44.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:44.833+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:44.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:44.841+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:45.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:45.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:45.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:45.877+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:46.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:46.853+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:46.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:46.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:47.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:47.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:47.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:47.925+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:48.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:48.873+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:48.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:48.945+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:49.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:49.849+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:49.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:49.989+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:50.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:50.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:50.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:50.957+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:51.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:51.853+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:51.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:51.945+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:52.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:52.849+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:52.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:52.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:53.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:53.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:53.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:53.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:54.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:54.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:55.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:54.997+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:55.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:55.845+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:56.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:56.045+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:56.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:56.857+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:57.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:57.069+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:57.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:57.845+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:58.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:58.109+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:58.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:58.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:59.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:45:59.109+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:45:59.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:45:59.869+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:00.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:00.081+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:00.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:00.873+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:01.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:01.113+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:01.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:01.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:02.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:02.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:02.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:02.904+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:03.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:03.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:03.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:03.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:04.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:04.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:04.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:04.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:05.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:05.120+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:05.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:05.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:06.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:06.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:06.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:06.756+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:07.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:07.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:07.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:07.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:08.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:08.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:08.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:08.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:09.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:09.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:09.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:09.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:10.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:10.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:10.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:10.784+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:11.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:11.076+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:11.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:11.792+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:12.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:12.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:12.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:12.792+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:13.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:13.072+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:13.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:13.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:14.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:14.056+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:14.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:14.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:15.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:15.076+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:15.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:15.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:16.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:16.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:16.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:16.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:17.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:17.004+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:17.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:17.924+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:18.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:18.016+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:18.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:18.964+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:19.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:19.048+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:19.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:19.948+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:20.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:20.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:20.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:20.952+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:21.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:21.032+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:21.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:21.964+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:22.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:22.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:22.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:22.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:23.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:23.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:23.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:23.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:23.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:23.976+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:24.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:24.860+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:25.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:25.004+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:25.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:25.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:26.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:26.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:26.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:26.816+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:27.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:27.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:27.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:27.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:27.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:27.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:28.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:28.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:29.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:29.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:29.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:29.820+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:30.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:30.092+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:30.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:30.784+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:31.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:31.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:31.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:31.820+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:32.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:32.092+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:32.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:32.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:33.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:33.056+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:33.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:33.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:34.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:34.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:34.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:34.940+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:35.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:35.084+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:35.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:35.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:36.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:36.072+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:36.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:36.924+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:37.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:37.076+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:37.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:37.960+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:38.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:38.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:39.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:39.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:39.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:39.004+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:39.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:39.964+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:40.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:40.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:40.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:40.972+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:41.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:41.020+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:41.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:41.988+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:41.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:41.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:42.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:42.956+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:43.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:43.012+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:43.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:43.944+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:44.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:44.036+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:44.900 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:44.896+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:45.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:45.032+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:45.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:45.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:46.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:46.076+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:46.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:46.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:47.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:47.060+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:47.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:47.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:48.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:48.100+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:48.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:48.860+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:49.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:49.084+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:49.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:49.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:50.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:50.052+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:50.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:50.796+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:51.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:51.084+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:51.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:51.823+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:52.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:52.099+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:52.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:52.819+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:53.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:53.087+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:53.824 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:53.819+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:54.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:54.059+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:54.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:54.791+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:55.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:55.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:55.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:55.811+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:56.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:56.059+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:56.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:56.771+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:57.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:57.107+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:57.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:57.803+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:58.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:58.083+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:58.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:58.819+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:59.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:46:59.071+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:46:59.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:46:59.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:00.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:00.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:00.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:00.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:01.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:01.079+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:01.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:01.803+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:02.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:02.043+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:02.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:02.791+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:03.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:03.003+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:03.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:03.747+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:04.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:04.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:04.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:04.723+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:05.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:05.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:05.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:05.727+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:06.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:06.039+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:06.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:06.687+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:07.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:07.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:07.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:07.671+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:08.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:08.083+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:08.641 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:08.635+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:09.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:09.079+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:09.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:09.643+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:10.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:10.115+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:10.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:10.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:11.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:11.127+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:11.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:11.639+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:12.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:12.175+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:12.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:12.595+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:13.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:13.183+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:13.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:13.627+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:14.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:14.195+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:14.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:14.675+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:15.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:15.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:15.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:15.659+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:16.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:16.171+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:16.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:16.643+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:17.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:17.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:17.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:17.599+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:18.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:18.179+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:18.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:18.603+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:19.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:19.175+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:19.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:19.567+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:20.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:20.171+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:20.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:20.571+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:21.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:21.219+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:21.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:21.547+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:22.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:22.251+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:22.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:22.511+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:23.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:23.267+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:23.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:23.511+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:24.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:24.291+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:24.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:24.563+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:25.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:25.251+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:25.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:25.563+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:26.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:26.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:26.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:26.587+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:27.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:27.183+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:27.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:27.571+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:28.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:28.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:28.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:28.531+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:29.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:29.199+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:29.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:29.495+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:30.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:30.207+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:30.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:30.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:31.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:31.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:31.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:31.491+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:32.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:32.227+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:32.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:32.463+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:33.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:33.259+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:33.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:33.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:34.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:34.259+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:34.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:34.423+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:35.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:35.219+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:35.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:35.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:36.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:36.243+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:36.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:36.375+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:37.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:37.199+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:37.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:37.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:38.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:38.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:38.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:38.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:39.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:39.187+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:39.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:39.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:40.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:40.226+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:40.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:40.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:41.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:41.226+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:41.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:41.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:42.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:42.262+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:42.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:42.270+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:43.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:43.242+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:43.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:43.286+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:44.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:44.270+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:44.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:44.290+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:45.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:45.278+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:45.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:45.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:46.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:46.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:46.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:46.318+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:47.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:47.274+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:47.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:47.290+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:48.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:48.310+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:48.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:48.318+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:49.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:49.282+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:49.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:49.326+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:50.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:50.290+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:50.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:50.310+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:51.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:51.318+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:51.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:51.322+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:52.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:52.338+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:52.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:52.342+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:53.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:53.330+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:53.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:53.386+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:54.298 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:54.290+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:54.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:54.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:55.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:55.246+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:55.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:55.322+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:56.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:56.234+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:56.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:56.310+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:57.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:57.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:57.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:57.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:58.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:58.230+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:58.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:58.294+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:59.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:47:59.262+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:47:59.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:47:59.266+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:00.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:00.310+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:00.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:00.314+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:01.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:01.306+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:01.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:01.314+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:02.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:02.278+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:02.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:02.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:03.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:03.242+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:03.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:03.290+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:04.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:04.238+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:04.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:04.250+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:05.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:05.222+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:05.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:05.242+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:06.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:06.218+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:06.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:06.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:07.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:07.226+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:07.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:07.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:08.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:08.238+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:08.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:08.286+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:09.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:09.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:09.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:09.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:10.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:10.246+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:10.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:10.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:11.270 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:11.262+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:11.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:11.326+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:12.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:12.298+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:12.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:12.378+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:13.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:13.314+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:13.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:13.366+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:14.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:14.310+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:14.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:14.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:15.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:15.326+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:15.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:15.442+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:16.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:16.334+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:16.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:16.434+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:17.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:17.370+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:17.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:17.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:18.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:18.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:18.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:18.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:19.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:19.314+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:19.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:19.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:20.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:20.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:20.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:20.394+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:21.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:21.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:21.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:21.430+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:22.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:22.326+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:22.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:22.474+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:23.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:23.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:23.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:23.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:24.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:24.270+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:24.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:24.470+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:25.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:25.226+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:25.474 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:25.466+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:26.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:26.262+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:26.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:26.446+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:27.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:27.218+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:27.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:27.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:28.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:28.266+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:28.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:28.454+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:29.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:29.221+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:29.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:29.457+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:30.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:30.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:30.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:30.449+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:31.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:31.205+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:31.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:31.485+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:32.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:32.201+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:32.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:32.501+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:33.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:33.209+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:33.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:33.521+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:34.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:34.213+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:34.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:34.557+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:35.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:35.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:35.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:35.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:36.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:36.281+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:36.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:36.629+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:37.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:37.277+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:37.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:37.589+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:38.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:38.237+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:38.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:38.601+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:39.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:39.265+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:39.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:39.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:40.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:40.241+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:40.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:40.629+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:41.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:41.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:41.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:41.625+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:42.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:42.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:42.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:42.577+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:43.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:43.257+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:43.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:43.561+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:44.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:44.257+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:44.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:44.545+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:45.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:45.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:45.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:45.577+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:46.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:46.321+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:46.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:46.605+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:47.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:47.325+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:47.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:47.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:48.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:48.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:48.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:48.609+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:49.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:49.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:49.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:49.617+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:50.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:50.257+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:50.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:50.601+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:51.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:51.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:51.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:51.573+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:52.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:52.309+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:52.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:52.537+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:53.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:53.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:53.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:53.585+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:54.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:54.277+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:54.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:54.577+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:55.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:55.241+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:55.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:55.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:56.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:56.245+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:56.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:56.637+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:57.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:57.281+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:57.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:57.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:58.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:58.329+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:58.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:58.601+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:59.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:48:59.305+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:48:59.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:48:59.573+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:00.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:00.349+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:00.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:00.549+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:01.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:01.321+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:01.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:01.557+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:02.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:02.369+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:02.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:02.589+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:03.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:03.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:03.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:03.605+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:04.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:04.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:04.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:04.565+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:05.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:05.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:05.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:05.609+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:06.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:06.385+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:06.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:06.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:07.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:07.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:07.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:07.653+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:08.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:08.437+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:08.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:08.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:09.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:09.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:09.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:09.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:10.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:10.393+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:10.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:10.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:11.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:11.349+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:11.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:11.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:12.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:12.361+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:12.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:12.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:13.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:13.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:13.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:13.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:14.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:14.297+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:14.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:14.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:15.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:15.329+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:15.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:15.809+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:16.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:16.369+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:16.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:16.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:17.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:17.376+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:17.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:17.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:18.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:18.416+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:18.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:18.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:19.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:19.444+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:19.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:19.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:20.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:20.400+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:20.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:20.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:21.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:21.360+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:21.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:21.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:22.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:22.404+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:22.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:22.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:23.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:23.376+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:23.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:23.816+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:24.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:24.392+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:24.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:24.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:25.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:25.436+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:25.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:25.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:26.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:26.388+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:26.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:26.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:27.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:27.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:27.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:27.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:28.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:28.352+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:28.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:28.820+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:29.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:29.368+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:29.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:29.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:30.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:30.324+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:30.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:30.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:31.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:31.336+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:31.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:31.712+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:32.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:32.352+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:32.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:32.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:33.358 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:33.352+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:33.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:33.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:34.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:34.364+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:34.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:34.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:35.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:35.408+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:35.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:35.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:36.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:36.396+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:36.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:36.668+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:37.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:37.400+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:37.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:37.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:38.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:38.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:38.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:38.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:39.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:39.404+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:39.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:39.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:40.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:40.384+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:40.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:40.636+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:41.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:41.396+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:41.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:41.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:42.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:42.436+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:42.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:42.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:43.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:43.400+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:43.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:43.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:44.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:44.388+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:44.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:44.632+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:45.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:45.412+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:45.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:45.620+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:46.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:46.440+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:46.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:46.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:47.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:47.452+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:47.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:47.632+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:48.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:48.488+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:48.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:48.584+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:49.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:49.444+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:49.585 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:49.580+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:50.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:50.456+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:50.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:50.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:51.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:51.412+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:51.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:51.520+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:52.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:52.376+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:52.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:52.520+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:53.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:53.368+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:53.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:53.484+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:54.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:54.416+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:54.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:54.468+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:55.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:55.404+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:55.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:55.488+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:56.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:56.416+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:56.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:56.480+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:57.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:57.440+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:57.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:57.472+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:58.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:58.428+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:58.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:58.452+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:59.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:49:59.424+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:49:59.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:49:59.436+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:00.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:00.412+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:00.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:00.432+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:01.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:01.400+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:01.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:01.412+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:02.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:02.368+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:02.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:02.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:03.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:03.372+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:03.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:03.404+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:04.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:04.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:04.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:04.360+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:05.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:05.307+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:05.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:05.315+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:06.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:06.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:06.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:06.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:07.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:07.235+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:07.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:07.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:08.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:08.267+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:08.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:08.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:09.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:09.227+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:09.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:09.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:10.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:10.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:10.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:10.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:11.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:11.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:11.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:11.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:12.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:12.219+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:12.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:12.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:13.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:13.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:13.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:13.367+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:14.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:14.211+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:14.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:14.387+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:15.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:15.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:15.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:15.379+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:16.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:16.239+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:16.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:16.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:17.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:17.199+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:17.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:17.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:18.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:18.227+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:18.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:18.335+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:19.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:19.207+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:19.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:19.351+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:20.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:20.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:20.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:20.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:21.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:21.199+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:21.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:21.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:22.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:22.195+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:22.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:22.403+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:23.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:23.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:23.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:23.379+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:24.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:24.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:24.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:24.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:25.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:25.223+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:25.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:25.391+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:26.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:26.235+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:26.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:26.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:27.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:27.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:27.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:27.475+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:28.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:28.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:28.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:28.463+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:29.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:29.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:29.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:29.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:30.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:30.235+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:30.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:30.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:31.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:31.199+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:31.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:31.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:32.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:32.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:32.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:32.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:33.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:33.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:33.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:33.399+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:34.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:34.251+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:34.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:34.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:35.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:35.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:35.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:35.491+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:36.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:36.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:36.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:36.479+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:37.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:37.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:37.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:37.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:38.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:38.223+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:38.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:38.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:39.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:39.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:39.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:39.515+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:40.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:40.155+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:40.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:40.535+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:41.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:41.115+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:41.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:41.495+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:42.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:42.067+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:42.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:42.539+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:43.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:43.051+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:43.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:43.495+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:44.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:44.099+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:44.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:44.475+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:45.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:45.063+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:45.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:45.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:46.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:46.095+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:46.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:46.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:47.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:47.131+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:47.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:47.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:48.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:48.147+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:48.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:48.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:49.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:49.175+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:49.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:49.383+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:50.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:50.219+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:50.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:50.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:51.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:51.223+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:51.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:51.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:52.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:52.262+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:52.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:52.286+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:53.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:53.230+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:53.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:53.322+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:54.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:54.238+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:54.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:54.342+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:55.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:55.282+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:55.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:55.386+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:56.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:56.286+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:56.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:56.414+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:57.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:57.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:57.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:57.390+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:58.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:58.290+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:58.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:58.402+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:59.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:50:59.250+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:50:59.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:50:59.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:00.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:00.270+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:00.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:00.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:01.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:01.242+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:01.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:01.366+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:02.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:02.198+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:02.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:02.366+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:03.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:03.150+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:03.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:03.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:04.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:04.106+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:04.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:04.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:05.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:05.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:05.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:05.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:06.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:06.146+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:06.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:06.426+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:07.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:07.162+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:07.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:07.414+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:08.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:08.122+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:08.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:08.454+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:09.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:09.102+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:09.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:09.430+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:10.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:10.126+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:10.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:10.462+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:11.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:11.142+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:11.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:11.426+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:12.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:12.126+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:12.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:12.422+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:13.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:13.078+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:13.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:13.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:14.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:14.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:14.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:14.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:15.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:15.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:15.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:15.370+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:16.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:16.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:16.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:16.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:17.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:17.086+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:17.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:17.298+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:18.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:18.090+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:18.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:18.262+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:19.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:19.082+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:19.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:19.234+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:20.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:20.070+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:20.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:20.262+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:21.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:21.046+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:21.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:21.254+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:22.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:22.058+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:22.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:22.282+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:23.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:23.098+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:23.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:23.278+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:24.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:24.118+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:24.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:24.318+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:25.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:25.154+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:25.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:25.330+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:26.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:26.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:26.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:26.346+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:27.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:27.142+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:27.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:27.370+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:28.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:28.174+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:28.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:28.418+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:29.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:29.206+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:29.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:29.454+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:30.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:30.158+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:30.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:30.426+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:31.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:31.146+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:31.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:31.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:32.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:32.194+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:32.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:32.438+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:33.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:33.222+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:33.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:33.430+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:34.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:34.186+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:34.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:34.438+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:35.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:35.230+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:35.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:35.458+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:36.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:36.266+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:36.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:36.450+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:37.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:37.286+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:37.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:37.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:38.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:38.318+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:38.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:38.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:39.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:39.285+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:39.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:39.433+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:40.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:40.237+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:40.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:40.389+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:41.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:41.265+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:41.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:41.441+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:42.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:42.257+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:42.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:42.469+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:43.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:43.265+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:43.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:43.481+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:44.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:44.269+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:44.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:44.449+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:45.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:45.321+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:45.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:45.409+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:46.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:46.349+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:46.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:46.433+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:47.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:47.393+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:47.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:47.397+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:48.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:48.405+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:48.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:48.437+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:49.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:49.405+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:49.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:49.437+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:50.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:50.445+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:50.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:50.457+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:51.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:51.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:51.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:51.413+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:52.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:52.449+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:52.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:52.453+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:53.430 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:53.421+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:53.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:53.457+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:54.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:54.389+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:54.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:54.489+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:55.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:55.409+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:55.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:55.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:56.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:56.397+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:56.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:56.461+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:57.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:57.365+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:57.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:57.441+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:58.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:58.385+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:58.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:58.437+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:59.413 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:51:59.405+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:51:59.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:51:59.489+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:00.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:00.409+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:00.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:00.493+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:01.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:01.397+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:01.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:01.477+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:02.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:02.393+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:02.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:02.437+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:03.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:03.441+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:03.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:03.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:04.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:04.429+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:04.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:04.469+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:05.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:05.425+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:05.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:05.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:06.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:06.425+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:06.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:06.525+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:07.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:07.465+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:07.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:07.545+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:08.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:08.473+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:08.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:08.541+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:09.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:09.481+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:09.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:09.545+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:10.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:10.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:10.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:10.505+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:11.514 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:11.505+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:11.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:11.521+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:12.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:12.461+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:12.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:12.525+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:13.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:13.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:13.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:13.553+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:14.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:14.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:14.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:14.505+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:15.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:15.397+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:15.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:15.501+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:16.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:16.425+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:16.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:16.537+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:17.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:17.433+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:17.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:17.509+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:18.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:18.433+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:18.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:18.537+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:19.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:19.397+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:19.574 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:19.569+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:20.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:20.377+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:20.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:20.601+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:21.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:21.417+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:21.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:21.585+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:22.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:22.469+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:22.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:22.581+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:23.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:23.437+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:23.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:23.585+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:24.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:24.485+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:24.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:24.625+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:25.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:25.489+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:25.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:25.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:26.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:26.480+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:26.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:26.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:27.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:27.468+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:27.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:27.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:28.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:28.444+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:28.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:28.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:29.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:29.468+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:29.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:29.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:30.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:30.476+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:30.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:30.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:31.527 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:31.520+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:31.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:31.716+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:32.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:32.484+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:32.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:32.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:33.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:33.496+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:33.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:33.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:34.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:34.468+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:34.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:34.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:35.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:35.424+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:35.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:35.720+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:36.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:36.472+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:36.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:36.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:37.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:37.424+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:37.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:37.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:38.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:38.468+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:38.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:38.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:39.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:39.480+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:39.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:39.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:40.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:40.508+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:40.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:40.672+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:41.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:41.472+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:41.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:41.716+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:42.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:42.448+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:42.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:42.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:43.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:43.488+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:43.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:43.716+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:44.539 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:44.532+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:44.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:44.712+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:45.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:45.552+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:45.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:45.684+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:46.538 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:46.532+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:46.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:46.644+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:47.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:47.536+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:47.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:47.612+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:48.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:48.580+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:48.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:48.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:49.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:49.628+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:49.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:49.672+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:50.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:50.624+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:50.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:50.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:51.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:51.624+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:51.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:51.700+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:52.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:52.616+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:52.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:52.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:53.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:53.580+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:53.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:53.716+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:54.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:54.592+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:54.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:54.672+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:55.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:55.560+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:55.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:55.696+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:56.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:56.572+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:56.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:56.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:57.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:57.604+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:57.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:57.696+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:58.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:58.584+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:58.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:58.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:59.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:52:59.540+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:52:59.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:52:59.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:00.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:00.536+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:00.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:00.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:01.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:01.536+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:01.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:01.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:02.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:02.564+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:02.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:02.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:03.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:03.520+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:03.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:03.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:04.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:04.544+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:04.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:04.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:05.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:05.528+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:05.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:05.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:06.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:06.488+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:06.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:06.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:07.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:07.476+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:07.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:07.736+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:08.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:08.492+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:08.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:08.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:09.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:09.448+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:09.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:09.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:10.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:10.448+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:10.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:10.736+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:11.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:11.448+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:11.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:11.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:12.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:12.444+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:12.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:12.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:13.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:13.423+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:13.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:13.731+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:14.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:14.439+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:14.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:14.779+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:15.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:15.439+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:15.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:15.739+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:16.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:16.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:16.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:16.707+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:17.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:17.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:17.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:17.675+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:18.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:18.407+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:18.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:18.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:19.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:19.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:19.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:19.611+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:20.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:20.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:20.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:20.575+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:21.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:21.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:21.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:21.583+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:22.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:22.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:22.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:22.535+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:23.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:23.475+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:23.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:23.575+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:24.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:24.471+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:24.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:24.591+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:25.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:25.511+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:25.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:25.627+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:26.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:26.499+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:26.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:26.591+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:27.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:27.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:27.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:27.591+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:28.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:28.503+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:28.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:28.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:29.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:29.487+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:29.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:29.683+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:30.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:30.535+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:30.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:30.687+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:31.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:31.535+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:31.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:31.655+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:32.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:32.507+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:32.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:32.655+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:33.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:33.519+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:33.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:33.667+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:34.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:34.559+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:34.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:34.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:35.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:35.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:35.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:35.739+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:36.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:36.583+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:36.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:36.775+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:37.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:37.571+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:37.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:37.791+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:38.627 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:38.619+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:38.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:38.827+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:39.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:39.591+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:39.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:39.823+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:40.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:40.559+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:40.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:40.783+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:41.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:41.567+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:41.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:41.751+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:42.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:42.527+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:42.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:42.711+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:43.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:43.507+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:43.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:43.667+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:44.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:44.547+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:44.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:44.695+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:45.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:45.591+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:45.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:45.723+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:46.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:46.555+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:46.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:46.763+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:47.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:47.535+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:47.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:47.779+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:48.527 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:48.519+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:48.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:48.775+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:49.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:49.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:49.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:49.775+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:50.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:50.439+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:50.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:50.771+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:51.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:51.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:51.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:51.811+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:52.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:52.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:52.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:52.795+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:53.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:53.435+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:53.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:53.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:54.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:54.431+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:54.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:54.739+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:55.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:55.479+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:55.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:55.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:56.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:56.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:56.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:56.767+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:57.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:57.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:57.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:57.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:58.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:58.491+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:58.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:58.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:59.494 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:53:59.487+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:53:59.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:53:59.707+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:00.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:00.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:00.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:00.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:01.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:01.430+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:01.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:01.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:02.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:02.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:02.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:02.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:03.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:03.362+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:03.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:03.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:04.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:04.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:04.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:04.582+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:05.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:05.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:05.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:05.550+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:06.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:06.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:06.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:06.594+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:07.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:07.366+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:07.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:07.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:08.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:08.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:08.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:08.594+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:09.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:09.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:09.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:09.602+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:10.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:10.422+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:10.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:10.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:11.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:11.398+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:11.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:11.582+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:12.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:12.426+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:12.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:12.566+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:13.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:13.414+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:13.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:13.610+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:14.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:14.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:14.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:14.582+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:15.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:15.390+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:15.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:15.598+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:16.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:16.386+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:16.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:16.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:17.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:17.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:17.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:17.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:18.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:18.382+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:18.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:18.670+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:19.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:19.378+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:19.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:19.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:20.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:20.330+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:20.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:20.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:21.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:21.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:21.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:21.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:22.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:22.350+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:22.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:22.614+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:23.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:23.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:23.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:23.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:24.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:24.306+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:24.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:24.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:25.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:25.334+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:25.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:25.726+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:26.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:26.290+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:26.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:26.770+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:27.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:27.302+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:27.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:27.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:28.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:28.270+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:28.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:28.726+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:29.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:29.246+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:29.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:29.746+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:30.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:30.214+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:30.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:30.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:31.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:31.210+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:31.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:31.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:32.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:32.210+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:32.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:32.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:33.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:33.230+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:33.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:33.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:34.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:34.190+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:34.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:34.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:35.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:35.154+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:35.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:35.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:36.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:36.118+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:36.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:36.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:37.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:37.086+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:37.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:37.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:38.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:38.130+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:38.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:38.590+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:39.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:39.150+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:39.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:39.610+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:40.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:40.166+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:40.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:40.582+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:41.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:41.134+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:41.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:41.622+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:42.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:42.094+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:42.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:42.590+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:43.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:43.106+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:43.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:43.638+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:44.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:44.130+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:44.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:44.670+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:45.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:45.166+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:45.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:45.674+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:46.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:46.198+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:46.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:46.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:47.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:47.225+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:47.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:47.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:48.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:48.221+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:48.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:48.653+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:49.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:49.205+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:49.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:49.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:50.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:50.193+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:50.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:50.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:51.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:51.185+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:51.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:51.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:52.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:52.209+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:52.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:52.669+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:53.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:53.177+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:53.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:53.653+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:54.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:54.213+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:54.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:54.669+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:55.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:55.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:55.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:55.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:56.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:56.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:56.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:56.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:57.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:57.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:57.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:57.657+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:58.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:58.197+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:58.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:58.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:59.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:54:59.149+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:54:59.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:54:59.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:00.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:00.189+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:00.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:00.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:01.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:01.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:01.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:01.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:02.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:02.197+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:02.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:02.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:03.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:03.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:03.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:03.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:04.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:04.245+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:04.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:04.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:05.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:05.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:05.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:05.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:06.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:06.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:06.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:06.741+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:07.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:07.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:07.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:07.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:08.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:08.277+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:08.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:08.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:09.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:09.233+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:09.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:09.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:10.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:10.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:10.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:10.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:11.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:11.313+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:11.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:11.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:12.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:12.269+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:12.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:12.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:13.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:13.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:13.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:13.657+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:14.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:14.273+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:14.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:14.653+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:15.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:15.229+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:15.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:15.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:16.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:16.257+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:16.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:16.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:17.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:17.261+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:17.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:17.561+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:18.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:18.277+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:18.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:18.577+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:19.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:19.253+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:19.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:19.589+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:20.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:20.209+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:20.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:20.617+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:21.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:21.173+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:21.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:21.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:22.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:22.213+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:22.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:22.605+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:23.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:23.197+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:23.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:23.621+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:24.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:24.165+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:24.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:24.657+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:25.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:25.185+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:25.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:25.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:26.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:26.201+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:26.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:26.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:27.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:27.221+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:27.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:27.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:28.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:28.237+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:28.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:28.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:29.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:29.285+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:29.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:29.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:30.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:30.285+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:30.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:30.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:31.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:31.245+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:31.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:31.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:32.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:32.289+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:32.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:32.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:33.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:33.312+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:33.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:33.772+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:34.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:34.320+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:34.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:34.804+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:35.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:35.300+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:35.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:35.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:36.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:36.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:36.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:36.808+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:37.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:37.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:37.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:37.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:38.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:38.212+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:38.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:38.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:39.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:39.224+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:39.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:39.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:40.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:40.276+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:40.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:40.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:41.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:41.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:41.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:41.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:42.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:42.200+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:42.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:42.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:43.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:43.208+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:43.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:43.976+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:44.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:44.160+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:44.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:44.952+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:45.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:45.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:45.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:45.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:46.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:46.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:46.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:46.924+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:47.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:47.112+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:47.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:47.972+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:48.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:48.144+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:49.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:48.996+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:49.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:49.176+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:50.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:50.024+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:50.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:50.136+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:51.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:51.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:51.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:51.164+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:52.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:52.016+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:52.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:52.164+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:53.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:53.040+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:53.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:53.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:54.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:54.076+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:54.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:54.172+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:55.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:55.096+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:55.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:55.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:56.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:56.096+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:56.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:56.212+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:57.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:57.060+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:57.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:57.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:58.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:58.096+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:58.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:58.264+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:59.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:55:59.060+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:55:59.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:55:59.296+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:00.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:00.088+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:00.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:00.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:01.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:01.048+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:01.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:01.312+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:02.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:02.060+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:02.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:02.324+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:03.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:03.068+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:03.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:03.336+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:04.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:04.088+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:04.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:04.364+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:05.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:05.044+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:05.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:05.372+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:06.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:06.068+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:06.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:06.336+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:07.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:07.104+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:07.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:07.364+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:08.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:08.104+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:08.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:08.352+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:09.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:09.092+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:09.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:09.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:10.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:10.132+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:10.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:10.332+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:11.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:11.136+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:11.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:11.380+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:12.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:12.148+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:12.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:12.372+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:13.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:13.168+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:13.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:13.328+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:14.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:14.220+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:14.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:14.284+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:15.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:15.184+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:15.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:15.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:16.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:16.204+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:16.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:16.264+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:17.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:17.168+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:17.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:17.240+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:18.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:18.200+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:18.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:18.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:19.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:19.184+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:19.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:19.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:20.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:20.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:20.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:20.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:21.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:21.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:21.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:21.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:22.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:22.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:22.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:22.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:23.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:23.283+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:23.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:23.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:24.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:24.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:24.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:24.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:25.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:25.287+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:25.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:25.463+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:26.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:26.275+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:26.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:26.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:27.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:27.239+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:27.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:27.443+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:28.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:28.239+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:28.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:28.407+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:29.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:29.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:29.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:29.379+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:30.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:30.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:30.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:30.399+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:31.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:31.303+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:31.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:31.363+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:32.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:32.335+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:32.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:32.347+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:33.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:33.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:33.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:33.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:34.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:34.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:34.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:34.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:35.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:35.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:35.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:35.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:36.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:36.315+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:36.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:36.319+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:37.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:37.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:37.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:37.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:38.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:38.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:38.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:38.343+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:39.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:39.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:39.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:39.323+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:40.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:40.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:40.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:40.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:41.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:41.299+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:41.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:41.335+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:42.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:42.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:42.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:42.387+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:43.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:43.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:43.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:43.419+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:44.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:44.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:44.399 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:44.391+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:45.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:45.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:45.395 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:45.387+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:46.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:46.355+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:46.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:46.387+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:47.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:47.363+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:47.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:47.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:48.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:48.359+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:48.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:48.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:49.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:49.339+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:49.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:49.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:50.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:50.331+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:50.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:50.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:51.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:51.291+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:51.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:51.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:52.266 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:52.259+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:52.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:52.407+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:53.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:53.251+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:53.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:53.427+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:54.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:54.295+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:54.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:54.471+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:55.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:55.275+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:55.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:55.519+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:56.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:56.239+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:56.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:56.511+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:57.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:57.267+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:57.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:57.543+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:58.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:58.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:58.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:58.523+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:59.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:56:59.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:56:59.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:56:59.507+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:00.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:00.307+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:00.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:00.495+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:01.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:01.287+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:01.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:01.459+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:02.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:02.247+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:02.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:02.487+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:03.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:03.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:03.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:03.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:04.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:04.303+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:04.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:04.483+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:05.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:05.311+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:05.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:05.499+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:06.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:06.326+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:06.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:06.466+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:07.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:07.330+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:07.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:07.458+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:08.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:08.350+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:08.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:08.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:09.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:09.346+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:09.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:09.462+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:10.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:10.346+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:10.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:10.486+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:11.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:11.378+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:11.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:11.494+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:12.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:12.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:12.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:12.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:13.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:13.358+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:13.514 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:13.506+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:14.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:14.402+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:14.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:14.498+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:15.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:15.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:15.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:15.454+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:16.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:16.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:16.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:16.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:17.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:17.370+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:17.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:17.398+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:18.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:18.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:18.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:18.430+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:19.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:19.406+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:19.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:19.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:20.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:20.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:20.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:20.398+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:21.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:21.370+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:21.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:21.434+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:22.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:22.354+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:22.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:22.446+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:23.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:23.342+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:23.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:23.482+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:24.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:24.390+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:24.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:24.514+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:25.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:25.422+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:25.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:25.506+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:26.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:26.402+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:26.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:26.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:27.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:27.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:27.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:27.522+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:28.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:28.410+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:28.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:28.554+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:29.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:29.402+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:29.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:29.542+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:30.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:30.394+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:30.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:30.498+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:31.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:31.414+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:31.464 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:31.454+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:32.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:32.434+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:32.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:32.462+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:33.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:33.470+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:33.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:33.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:34.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:34.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:34.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:34.526+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:35.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:35.434+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:35.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:35.534+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:36.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:36.474+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:36.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:36.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:37.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:37.442+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:37.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:37.498+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:38.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:38.482+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:38.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:38.514+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:39.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:39.486+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:39.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:39.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:40.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:40.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:40.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:40.538+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:41.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:41.478+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:41.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:41.590+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:42.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:42.522+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:42.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:42.610+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:43.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:43.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:43.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:43.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:44.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:44.618+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:44.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:44.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:45.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:45.610+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:45.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:45.750+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:46.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:46.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:46.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:46.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:47.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:47.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:47.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:47.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:48.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:48.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:48.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:48.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:49.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:49.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:49.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:49.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:50.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:50.618+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:50.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:50.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:51.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:51.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:51.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:51.634+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:52.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:52.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:52.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:52.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:53.637 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:53.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:53.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:53.638+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:54.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:54.586+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:54.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:54.674+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:55.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:55.578+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:55.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:55.690+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:56.539 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:56.529+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:56.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:56.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:57.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:57.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:57.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:57.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:58.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:58.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:58.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:58.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:59.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:57:59.441+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:57:59.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:57:59.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:00.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:00.445+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:00.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:00.717+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:01.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:01.453+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:01.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:01.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:02.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:02.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:02.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:02.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:03.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:03.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:03.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:03.757+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:04.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:04.549+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:04.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:04.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:05.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:05.597+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:05.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:05.713+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:06.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:06.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:06.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:06.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:07.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:07.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:07.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:07.681+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:08.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:08.653+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:08.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:08.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:09.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:09.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:09.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:09.657+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:10.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:10.633+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:10.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:10.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:11.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:11.585+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:11.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:11.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:12.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:12.545+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:12.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:12.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:13.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:13.525+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:13.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:13.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:14.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:14.565+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:14.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:14.741+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:15.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:15.577+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:15.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:15.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:16.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:16.545+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:16.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:16.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:17.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:17.533+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:17.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:17.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:18.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:18.573+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:18.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:18.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:19.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:19.621+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:19.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:19.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:20.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:20.673+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:20.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:20.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:21.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:21.665+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:21.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:21.717+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:22.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:22.681+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:22.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:22.713+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:23.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:23.693+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:23.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:23.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:24.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:24.661+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:24.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:24.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:25.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:25.673+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:25.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:25.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:26.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:26.673+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:26.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:26.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:27.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:27.689+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:27.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:27.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:28.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:28.661+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:28.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:28.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:29.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:29.697+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:29.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:29.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:30.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:30.669+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:30.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:30.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:31.652 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:31.641+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:31.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:31.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:32.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:32.657+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:32.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:32.805+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:33.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:33.697+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:33.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:33.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:34.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:34.653+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:34.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:34.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:35.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:35.645+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:35.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:35.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:36.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:36.689+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:36.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:36.713+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:37.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:37.673+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:37.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:37.741+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:38.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:38.717+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:38.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:38.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:39.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:39.717+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:39.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:39.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:40.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:40.765+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:40.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:40.805+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:41.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:41.785+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:41.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:41.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:42.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:42.753+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:42.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:42.825+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:43.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:43.781+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:43.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:43.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:44.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:44.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:44.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:44.821+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:45.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:45.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:45.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:45.849+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:46.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:46.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:46.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:46.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:47.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:47.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:47.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:47.884+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:48.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:48.696+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:48.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:48.876+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:49.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:49.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:49.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:49.900+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:50.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:50.680+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:50.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:50.932+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:51.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:51.640+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:51.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:51.916+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:52.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:52.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:52.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:52.888+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:53.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:53.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:53.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:53.904+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:54.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:54.608+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:54.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:54.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:55.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:55.612+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:55.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:55.828+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:56.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:56.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:56.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:56.880+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:57.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:57.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:57.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:57.916+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:58.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:58.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:58.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:58.952+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:59.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:58:59.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:58:59.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:58:59.988+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:00.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:00.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:01.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:01.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:01.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:01.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:02.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:02.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:02.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:02.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:03.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:03.060+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:03.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:03.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:04.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:04.072+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:04.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:04.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:05.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:05.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:05.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:05.580+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:06.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:06.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:06.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:06.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:07.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:07.064+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:07.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:07.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:08.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:08.036+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:08.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:08.628+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:09.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:09.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:09.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:09.584+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:09.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:09.972+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:10.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:10.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:10.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:10.960+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:11.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:11.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:11.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:11.948+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:12.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:12.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:12.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:12.968+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:13.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:13.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:13.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:13.984+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:14.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:14.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:14.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:14.984+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:15.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:15.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:16.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:16.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:16.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:16.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:17.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:17.040+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:17.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:17.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:18.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:18.024+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:18.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:18.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:19.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:19.020+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:19.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:19.544+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:20.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:20.016+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:20.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:20.532+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:20.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:20.992+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:21.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:21.548+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:22.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:22.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:22.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:22.580+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:22.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:22.980+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:23.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:23.536+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:23.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:23.944+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:24.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:24.528+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:24.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:24.952+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:25.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:25.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:25.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:25.948+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:26.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:26.540+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:26.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:26.924+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:27.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:27.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:27.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:27.948+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:28.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:28.528+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:28.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:28.972+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:29.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:29.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:29.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:29.940+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:30.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:30.568+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:30.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:30.956+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:31.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:31.524+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:31.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:31.968+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:32.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:32.552+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:32.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:32.936+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:33.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:33.552+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:33.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:33.984+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:34.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:34.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:34.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:34.980+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:35.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:35.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:36.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:36.012+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:36.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:36.588+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:37.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:37.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:37.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:37.616+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:38.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:38.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:38.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:38.627+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:39.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:39.043+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:39.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:39.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:40.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:40.043+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:40.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:40.647+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:41.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:41.015+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:41.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:41.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:42.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:42.015+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:42.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:42.651+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:43.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:43.027+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:43.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:43.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:44.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:44.047+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:44.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:44.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:45.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:45.083+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:45.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:45.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:46.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:46.087+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:46.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:46.711+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:47.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:47.123+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:47.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:47.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:48.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:48.091+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:48.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:48.687+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:49.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:49.043+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:49.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:49.715+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:50.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:50.067+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:50.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:50.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:51.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:51.091+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:51.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:51.695+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:52.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:52.047+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:52.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:52.703+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:53.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:53.075+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:53.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:53.711+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:54.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:54.119+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:54.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:54.711+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:55.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:55.167+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:55.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:55.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:56.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:56.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:56.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:56.695+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:57.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:57.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:57.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:57.655+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:58.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:58.151+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:58.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:58.691+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:59.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T11:59:59.115+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T11:59:59.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T11:59:59.647+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:00.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:00.147+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:00.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:00.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:01.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:01.191+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:01.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:01.655+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:02.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:02.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:02.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:02.659+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:03.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:03.239+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:03.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:03.651+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:04.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:04.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:04.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:04.691+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:05.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:05.227+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:05.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:05.695+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:06.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:06.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:06.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:06.695+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:07.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:07.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:07.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:07.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:08.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:08.243+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:08.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:08.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:09.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:09.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:09.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:09.763+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:10.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:10.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:10.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:10.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:11.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:11.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:11.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:11.727+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:12.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:12.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:12.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:12.687+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:13.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:13.231+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:13.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:13.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:14.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:14.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:14.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:14.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:15.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:15.215+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:15.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:15.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:16.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:16.259+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:16.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:16.679+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:17.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:17.215+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:17.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:17.707+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:18.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:18.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:18.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:18.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:19.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:19.199+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:19.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:19.715+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:20.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:20.215+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:20.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:20.763+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:21.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:21.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:21.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:21.731+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:22.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:22.195+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:22.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:22.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:23.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:23.147+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:23.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:23.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:24.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:24.151+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:24.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:24.787+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:25.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:25.135+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:25.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:25.747+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:26.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:26.167+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:26.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:26.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:27.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:27.159+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:27.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:27.779+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:28.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:28.147+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:28.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:28.759+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:29.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:29.123+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:29.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:29.783+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:30.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:30.111+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:30.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:30.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:31.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:31.122+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:31.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:31.738+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:32.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:32.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:32.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:32.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:33.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:33.110+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:33.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:33.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:34.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:34.154+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:34.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:34.802+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:35.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:35.122+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:35.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:35.842+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:36.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:36.078+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:36.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:36.814+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:37.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:37.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:37.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:37.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:38.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:38.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:38.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:38.766+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:38.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:38.978+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:39.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:39.774+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:39.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:39.982+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:40.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:40.818+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:40.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:40.974+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:41.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:41.862+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:41.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:41.990+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:42.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:42.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:43.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:43.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:43.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:43.938+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:44.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:44.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:44.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:44.894+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:45.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:45.038+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:45.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:45.878+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:46.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:46.006+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:46.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:46.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:47.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:47.026+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:47.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:47.850+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:48.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:47.994+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:48.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:48.818+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:49.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:49.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:49.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:49.830+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:49.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:49.986+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:50.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:50.874+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:50.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:50.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:51.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:51.870+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:52.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:51.994+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:52.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:52.850+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:53.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:53.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:53.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:53.854+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:54.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:54.078+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:54.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:54.842+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:55.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:55.046+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:55.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:55.850+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:56.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:56.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:56.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:56.898+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:56.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:56.978+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:57.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:57.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:58.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:58.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:58.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:58.870+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:58.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:58.974+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:59.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:00:59.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:00:59.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:00:59.950+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:00.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:00.894+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:00.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:00.962+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:01.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:01.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:01.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:01.938+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:02.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:02.866+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:02.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:02.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:03.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:03.838+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:03.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:03.926+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:04.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:04.818+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:04.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:04.906+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:05.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:05.826+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:05.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:05.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:06.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:06.870+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:06.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:06.930+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:07.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:07.842+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:07.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:07.978+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:08.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:08.874+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:09.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:09.022+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:09.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:09.830+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:10.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:10.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:10.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:10.806+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:11.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:11.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:11.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:11.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:11.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:11.982+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:12.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:12.794+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:12.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:12.950+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:13.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:13.798+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:13.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:13.958+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:14.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:14.834+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:15.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:15.006+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:15.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:15.810+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:15.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:15.974+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:16.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:16.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:17.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:17.018+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:17.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:17.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:18.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:18.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:18.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:18.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:19.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:19.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:19.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:19.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:20.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:20.062+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:20.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:20.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:21.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:21.082+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:21.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:21.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:22.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:22.089+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:22.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:22.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:23.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:23.109+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:23.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:23.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:24.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:24.085+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:24.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:24.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:25.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:25.101+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:25.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:25.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:26.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:26.117+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:26.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:26.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:27.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:27.153+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:27.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:27.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:28.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:28.173+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:28.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:28.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:29.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:29.149+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:29.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:29.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:30.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:30.113+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:30.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:30.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:31.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:31.105+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:31.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:31.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:32.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:32.117+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:32.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:32.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:33.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:33.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:33.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:33.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:34.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:34.121+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:34.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:34.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:35.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:35.097+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:35.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:35.757+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:36.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:36.061+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:36.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:36.713+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:37.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:37.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:37.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:37.757+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:38.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:38.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:38.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:38.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:39.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:39.017+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:39.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:39.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:40.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:40.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:40.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:40.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:40.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:40.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:41.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:41.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:41.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:41.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:42.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:42.637+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:42.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:42.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:43.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:43.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:43.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:43.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:44.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:44.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:44.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:44.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:45.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:45.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:45.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:45.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:46.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:46.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:46.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:46.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:47.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:47.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:48.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:48.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:48.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:48.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:49.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:49.033+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:49.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:49.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:50.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:50.037+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:50.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:50.741+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:51.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:51.017+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:51.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:51.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:52.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:52.061+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:52.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:52.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:53.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:53.021+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:53.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:53.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:54.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:53.997+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:54.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:54.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:54.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:54.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:55.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:55.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:55.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:55.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:56.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:56.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:56.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:56.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:57.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:57.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:57.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:57.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:58.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:58.617+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:58.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:58.973+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:59.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:01:59.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:01:59.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:01:59.937+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:00.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:00.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:00.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:00.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:01.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:01.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:01.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:01.845+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:02.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:02.729+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:02.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:02.809+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:03.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:03.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:03.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:03.789+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:04.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:04.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:04.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:04.829+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:05.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:05.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:05.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:05.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:06.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:06.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:06.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:06.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:07.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:07.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:07.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:07.873+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:08.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:08.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:08.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:08.849+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:09.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:09.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:09.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:09.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:10.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:10.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:10.900 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:10.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:11.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:11.817+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:11.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:11.929+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:12.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:12.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:12.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:12.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:13.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:13.825+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:13.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:13.925+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:14.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:14.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:14.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:14.909+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:15.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:15.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:15.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:15.864+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:16.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:16.804+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:16.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:16.872+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:17.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:17.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:17.892 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:17.884+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:18.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:18.796+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:18.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:18.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:19.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:19.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:19.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:19.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:20.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:20.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:20.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:20.888+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:21.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:21.816+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:21.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:21.916+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:22.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:22.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:22.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:22.912+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:23.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:23.864+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:23.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:23.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:24.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:24.820+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:24.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:24.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:25.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:25.832+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:25.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:25.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:26.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:26.860+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:26.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:26.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:27.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:27.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:27.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:27.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:28.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:28.852+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:28.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:28.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:29.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:29.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:29.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:29.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:30.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:30.832+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:30.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:30.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:31.858 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:31.852+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:31.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:31.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:32.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:32.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:32.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:32.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:33.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:33.820+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:33.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:33.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:34.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:34.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:34.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:34.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:35.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:35.768+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:35.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:35.864+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:36.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:36.752+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:36.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:36.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:37.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:37.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:37.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:37.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:38.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:38.696+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:38.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:38.860+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:39.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:39.692+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:39.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:39.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:40.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:40.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:40.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:40.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:41.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:41.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:41.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:41.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:42.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:42.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:42.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:42.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:43.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:43.676+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:43.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:43.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:44.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:44.696+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:44.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:44.968+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:45.740 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:45.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:45.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:45.972+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:46.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:46.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:46.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:46.968+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:47.746 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:47.740+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:47.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:47.968+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:48.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:48.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:48.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:48.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:49.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:49.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:49.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:49.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:50.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:50.780+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:50.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:50.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:51.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:51.764+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:51.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:51.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:52.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:52.748+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:52.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:52.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:53.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:53.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:53.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:53.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:54.766 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:54.760+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:54.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:54.936+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:55.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:55.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:55.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:55.904+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:56.740 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:56.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:56.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:56.872+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:57.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:57.772+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:57.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:57.824+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:58.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:58.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:58.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:58.792+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:59.733 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:02:59.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:02:59.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:02:59.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:00.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:00.768+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:00.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:00.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:01.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:01.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:01.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:01.808+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:02.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:02.792+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:02.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:02.792+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:03.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:03.752+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:03.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:03.808+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:04.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:04.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:04.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:04.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:05.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:05.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:05.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:05.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:06.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:06.700+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:06.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:06.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:07.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:07.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:07.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:07.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:08.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:08.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:08.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:08.864+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:09.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:09.719+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:09.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:09.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:10.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:10.731+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:10.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:10.867+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:11.753 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:11.747+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:11.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:11.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:12.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:12.743+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:12.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:12.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:13.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:13.707+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:13.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:13.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:14.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:14.751+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:14.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:14.975+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:15.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:15.783+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:16.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:16.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:16.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:16.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:17.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:17.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:17.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:17.799+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:18.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:18.039+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:18.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:18.847+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:19.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:19.063+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:19.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:19.867+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:20.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:20.087+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:20.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:20.875+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:21.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:21.119+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:21.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:21.839+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:22.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:22.107+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:22.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:22.839+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:23.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:23.095+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:23.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:23.831+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:24.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:24.107+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:24.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:24.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:25.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:25.103+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:25.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:25.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:26.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:26.151+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:26.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:26.939+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:27.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:27.175+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:27.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:27.991+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:28.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:28.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:28.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:28.983+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:29.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:29.211+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:30.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:30.007+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:30.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:30.179+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:31.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:31.039+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:31.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:31.151+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:32.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:32.027+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:32.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:32.155+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:32.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:32.983+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:33.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:33.187+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:33.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:33.943+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:34.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:34.179+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:34.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:34.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:35.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:35.135+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:35.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:35.915+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:36.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:36.099+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:36.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:36.923+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:37.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:37.147+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:37.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:37.939+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:38.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:38.107+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:38.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:38.935+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:39.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:39.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:39.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:39.899+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:40.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:40.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:40.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:40.875+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:41.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:41.051+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:41.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:41.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:42.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:42.047+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:42.895 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:42.887+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:43.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:43.039+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:43.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:43.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:44.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:44.003+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:44.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:44.843+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:44.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:44.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:45.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:45.835+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:45.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:45.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:46.852 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:46.843+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:46.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:46.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:47.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:47.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:47.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:47.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:48.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:48.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:48.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:48.919+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:49.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:49.927+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:49.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:49.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:50.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:50.927+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:50.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:50.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:51.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:51.891+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:51.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:51.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:52.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:52.859+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:52.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:52.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:53.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:53.899+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:53.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:53.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:54.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:54.891+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:54.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:54.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:55.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:55.871+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:55.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:55.891+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:56.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:56.835+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:56.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:56.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:57.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:57.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:57.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:57.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:58.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:58.815+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:58.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:58.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:59.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:03:59.803+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:03:59.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:03:59.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:00.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:00.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:00.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:00.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:01.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:01.751+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:01.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:01.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:02.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:02.711+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:02.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:02.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:03.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:03.706+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:03.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:03.926+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:04.676 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:04.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:04.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:04.914+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:05.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:05.642+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:05.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:05.930+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:06.614 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:06.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:06.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:06.978+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:07.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:07.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:07.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:07.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:08.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:08.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:09.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:09.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:09.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:09.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:10.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:10.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:10.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:10.598+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:11.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:11.038+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:11.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:11.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:12.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:12.006+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:12.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:12.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:12.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:12.974+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:13.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:13.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:14.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:13.998+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:14.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:14.690+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:15.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:14.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:15.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:15.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:16.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:16.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:16.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:16.674+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:17.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:17.066+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:17.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:17.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:18.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:18.018+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:18.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:18.634+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:19.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:19.066+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:19.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:19.590+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:20.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:20.078+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:20.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:20.610+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:21.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:21.054+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:21.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:21.610+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:22.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:22.086+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:22.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:22.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:23.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:23.122+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:23.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:23.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:24.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:24.106+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:24.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:24.550+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:25.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:25.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:25.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:25.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:26.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:26.102+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:26.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:26.554+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:27.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:27.074+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:27.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:27.590+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:28.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:28.118+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:28.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:28.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:29.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:29.158+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:29.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:29.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:30.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:30.162+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:30.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:30.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:31.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:31.130+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:31.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:31.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:32.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:32.114+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:32.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:32.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:33.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:33.118+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:33.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:33.678+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:34.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:34.138+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:34.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:34.718+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:35.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:35.110+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:35.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:35.690+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:36.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:36.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:36.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:36.694+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:37.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:37.094+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:37.712 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:37.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:38.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:38.066+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:38.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:38.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:39.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:39.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:39.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:39.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:40.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:40.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:40.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:40.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:41.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:41.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:41.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:41.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:42.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:42.070+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:42.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:42.698+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:43.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:43.030+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:43.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:43.726+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:44.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:44.034+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:44.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:44.698+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:45.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:45.066+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:45.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:45.702+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:46.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:46.062+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:46.740 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:46.730+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:47.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:47.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:47.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:47.746+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:48.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:48.050+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:48.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:48.774+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:49.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:49.042+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:49.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:49.742+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:50.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:49.994+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:50.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:50.706+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:51.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:50.990+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:51.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:51.714+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:51.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:51.962+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:52.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:52.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:52.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:52.950+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:53.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:53.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:53.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:53.986+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:54.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:54.674+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:54.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:54.970+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:55.637 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:55.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:55.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:55.934+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:56.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:56.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:56.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:56.902+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:57.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:57.626+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:57.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:57.878+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:58.627 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:58.618+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:58.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:58.834+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:59.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:04:59.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:04:59.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:04:59.790+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:00.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:00.642+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:00.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:00.782+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:01.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:01.669+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:01.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:01.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:02.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:02.697+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:02.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:02.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:03.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:03.741+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:03.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:03.873+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:04.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:04.769+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:04.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:04.841+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:05.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:05.805+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:05.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:05.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:06.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:06.825+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:06.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:06.837+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:07.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:07.793+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:07.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:07.829+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:08.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:08.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:08.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:08.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:09.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:09.809+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:09.831 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:09.821+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:10.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:10.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:10.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:10.857+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:11.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:11.809+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:11.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:11.861+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:12.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:12.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:12.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:12.817+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:13.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:13.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:13.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:13.857+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:14.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:14.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:14.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:14.877+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:15.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:15.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:15.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:15.877+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:16.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:16.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:16.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:16.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:17.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:17.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:17.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:17.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:18.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:18.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:18.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:18.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:19.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:19.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:19.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:19.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:20.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:20.729+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:20.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:20.925+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:21.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:21.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:21.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:21.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:22.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:22.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:22.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:22.909+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:23.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:23.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:23.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:23.957+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:24.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:24.805+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:24.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:24.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:25.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:25.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:25.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:25.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:26.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:26.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:26.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:26.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:27.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:27.857+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:27.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:27.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:28.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:28.861+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:28.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:28.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:29.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:29.877+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:29.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:29.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:30.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:30.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:30.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:30.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:31.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:31.921+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:31.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:31.949+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:32.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:32.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:32.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:32.977+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:33.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:33.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:34.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:34.005+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:34.892 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:34.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:35.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:35.041+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:35.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:35.869+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:36.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:36.013+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:36.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:36.853+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:37.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:37.017+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:37.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:37.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:38.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:38.045+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:38.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:38.845+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:39.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:39.001+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:39.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:39.889+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:39.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:39.969+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:40.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:40.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:40.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:40.961+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:41.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:41.933+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:41.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:41.937+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:42.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:42.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:42.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:42.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:43.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:43.889+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:43.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:43.989+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:44.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:44.901+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:44.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:44.945+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:45.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:45.897+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:45.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:45.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:46.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:46.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:46.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:46.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:47.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:47.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:47.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:47.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:48.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:48.889+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:48.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:48.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:49.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:49.933+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:49.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:49.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:50.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:50.949+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:50.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:50.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:51.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:51.929+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:51.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:51.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:52.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:52.941+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:52.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:52.941+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:53.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:53.941+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:53.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:53.945+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:54.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:54.901+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:54.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:54.961+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:55.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:55.861+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:55.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:55.985+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:56.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:56.813+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:57.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:56.997+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:57.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:57.797+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:58.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:58.041+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:58.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:58.848+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:59.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:05:59.020+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:05:59.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:05:59.800+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:00.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:00.048+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:00.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:00.824+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:01.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:01.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:01.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:01.856+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:02.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:02.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:02.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:02.864+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:03.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:03.016+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:03.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:03.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:04.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:04.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:04.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:04.816+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:04.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:04.984+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:05.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:05.796+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:06.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:06.032+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:06.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:06.764+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:07.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:07.076+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:07.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:07.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:08.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:08.100+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:08.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:08.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:09.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:09.072+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:09.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:09.720+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:10.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:10.032+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:10.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:10.688+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:11.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:11.036+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:11.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:11.648+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:12.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:12.068+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:12.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:12.692+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:13.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:13.020+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:13.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:13.696+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:13.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:13.976+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:14.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:14.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:14.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:14.940+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:15.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:15.688+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:15.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:15.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:16.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:16.664+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:16.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:16.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:17.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:17.688+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:17.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:17.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:18.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:18.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:18.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:18.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:19.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:19.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:19.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:19.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:20.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:20.700+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:20.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:20.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:21.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:21.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:21.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:21.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:22.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:22.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:22.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:22.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:23.712 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:23.704+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:23.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:23.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:24.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:24.708+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:24.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:24.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:25.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:25.740+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:25.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:25.952+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:26.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:26.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:26.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:26.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:27.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:27.764+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:27.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:27.948+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:28.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:28.796+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:28.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:28.948+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:29.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:29.752+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:29.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:29.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:30.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:30.756+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:30.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:30.940+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:31.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:31.776+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:31.974 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:31.968+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:32.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:32.728+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:33.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:33.012+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:33.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:33.760+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:34.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:34.020+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:34.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:34.808+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:34.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:34.992+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:35.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:35.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:36.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:36.040+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:36.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:36.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:37.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:37.020+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:37.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:37.808+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:38.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:38.004+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:38.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:38.856+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:39.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:39.024+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:39.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:39.880+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:40.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:40.048+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:40.858 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:40.852+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:41.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:41.068+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:41.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:41.856+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:42.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:42.068+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:42.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:42.820+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:43.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:43.076+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:43.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:43.860+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:44.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:44.120+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:44.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:44.816+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:45.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:45.088+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:45.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:45.768+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:46.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:46.044+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:46.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:46.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:47.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:47.040+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:47.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:47.780+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:48.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:48.004+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:48.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:48.744+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:49.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:49.000+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:49.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:49.772+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:50.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:50.028+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:50.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:50.732+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:51.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:51.036+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:51.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:51.724+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:52.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:52.084+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:52.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:52.748+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:53.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:53.116+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:53.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:53.772+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:54.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:54.128+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:54.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:54.823+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:55.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:55.163+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:55.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:55.799+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:56.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:56.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:56.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:56.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:57.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:57.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:57.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:57.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:58.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:58.195+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:58.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:58.775+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:59.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:06:59.239+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:06:59.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:06:59.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:00.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:00.203+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:00.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:00.775+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:01.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:01.207+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:01.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:01.767+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:02.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:02.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:02.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:02.783+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:03.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:03.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:03.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:03.815+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:04.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:04.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:04.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:04.811+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:05.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:05.223+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:05.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:05.827+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:06.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:06.267+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:06.831 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:06.823+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:07.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:07.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:07.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:07.867+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:08.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:08.283+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:08.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:08.835+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:09.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:09.303+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:09.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:09.807+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:10.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:10.315+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:10.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:10.759+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:11.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:11.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:11.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:11.771+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:12.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:12.275+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:12.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:12.783+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:13.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:13.271+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:13.830 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:13.823+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:14.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:14.299+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:14.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:14.815+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:15.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:15.319+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:15.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:15.791+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:16.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:16.363+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:16.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:16.771+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:17.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:17.319+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:17.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:17.775+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:18.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:18.291+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:18.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:18.827+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:19.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:19.279+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:19.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:19.835+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:20.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:20.255+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:20.830 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:20.823+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:21.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:21.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:21.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:21.839+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:22.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:22.167+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:22.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:22.835+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:23.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:23.183+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:23.859 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:23.851+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:24.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:24.211+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:24.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:24.831+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:25.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:25.231+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:25.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:25.803+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:26.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:26.227+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:26.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:26.767+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:27.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:27.227+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:27.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:27.775+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:28.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:28.179+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:28.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:28.775+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:29.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:29.179+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:29.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:29.803+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:30.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:30.131+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:30.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:30.755+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:31.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:31.143+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:31.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:31.783+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:32.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:32.191+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:32.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:32.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:33.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:33.215+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:33.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:33.783+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:34.270 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:34.263+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:34.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:34.755+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:35.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:35.283+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:35.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:35.807+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:36.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:36.335+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:36.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:36.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:37.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:37.315+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:37.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:37.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:38.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:38.275+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:38.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:38.767+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:39.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:39.315+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:39.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:39.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:40.319 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:40.311+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:40.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:40.827+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:41.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:41.359+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:41.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:41.875+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:42.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:42.399+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:42.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:42.923+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:43.387 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:43.379+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:43.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:43.903+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:44.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:44.383+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:44.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:44.875+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:45.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:45.351+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:45.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:45.891+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:46.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:46.315+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:46.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:46.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:47.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:47.327+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:47.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:47.879+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:48.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:48.335+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:48.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:48.907+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:49.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:49.374+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:49.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:49.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:50.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:50.382+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:50.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:50.942+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:51.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:51.350+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:51.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:51.958+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:52.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:52.338+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:52.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:52.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:53.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:53.326+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:53.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:53.878+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:54.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:54.322+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:54.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:54.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:55.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:55.314+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:55.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:55.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:56.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:56.338+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:56.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:56.890+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:57.320 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:57.314+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:57.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:57.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:58.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:58.302+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:58.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:58.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:59.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:07:59.306+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:07:59.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:07:59.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:00.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:00.334+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:00.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:00.890+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:01.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:01.314+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:01.869 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:01.862+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:02.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:02.274+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:02.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:02.870+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:03.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:03.322+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:03.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:03.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:04.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:04.350+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:04.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:04.870+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:05.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:05.354+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:05.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:05.862+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:06.395 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:06.386+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:06.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:06.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:07.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:07.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:07.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:07.842+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:08.423 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:08.414+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:08.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:08.862+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:09.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:09.370+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:09.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:09.898+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:10.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:10.370+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:10.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:10.874+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:11.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:11.334+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:11.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:11.854+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:12.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:12.302+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:12.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:12.814+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:13.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:13.334+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:13.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:13.770+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:14.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:14.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:14.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:14.786+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:15.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:15.390+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:15.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:15.826+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:16.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:16.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:16.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:16.830+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:17.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:17.398+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:17.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:17.878+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:18.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:18.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:18.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:18.874+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:19.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:19.374+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:19.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:19.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:20.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:20.390+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:20.821 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:20.814+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:21.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:21.426+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:21.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:21.830+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:22.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:22.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:22.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:22.786+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:23.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:23.366+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:23.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:23.814+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:24.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:24.410+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:24.844 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:24.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:25.451 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:25.442+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:25.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:25.858+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:26.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:26.402+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:26.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:26.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:27.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:27.430+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:27.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:27.798+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:28.431 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:28.422+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:28.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:28.774+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:29.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:29.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:29.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:29.814+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:30.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:30.438+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:30.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:30.802+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:31.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:31.430+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:31.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:31.798+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:32.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:32.406+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:32.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:32.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:33.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:33.430+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:33.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:33.878+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:34.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:34.454+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:34.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:34.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:35.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:35.494+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:35.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:35.918+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:36.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:36.506+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:36.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:36.930+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:37.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:37.554+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:37.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:37.886+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:38.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:38.534+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:38.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:38.878+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:39.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:39.518+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:39.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:39.930+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:40.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:40.566+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:40.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:40.894+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:41.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:41.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:41.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:41.866+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:42.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:42.562+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:42.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:42.881+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:43.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:43.581+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:43.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:43.877+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:44.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:44.533+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:44.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:44.893+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:45.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:45.569+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:45.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:45.913+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:46.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:46.597+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:46.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:46.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:47.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:47.589+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:48.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:48.009+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:48.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:48.557+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:49.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:49.037+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:49.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:49.509+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:50.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:50.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:50.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:50.505+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:50.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:50.989+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:51.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:51.545+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:51.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:51.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:52.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:52.577+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:53.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:53.017+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:53.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:53.557+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:54.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:53.997+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:54.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:54.569+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:54.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:54.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:55.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:55.617+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:56.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:56.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:56.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:56.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:57.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:57.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:57.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:57.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:58.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:58.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:58.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:58.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:58.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:58.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:59.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:08:59.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:08:59.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:08:59.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:00.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:00.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:01.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:01.021+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:01.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:01.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:02.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:02.025+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:02.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:02.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:03.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:03.045+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:03.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:03.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:04.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:04.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:04.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:04.609+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:05.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:05.041+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:05.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:05.629+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:06.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:06.021+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:06.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:06.617+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:07.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:07.013+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:07.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:07.609+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:07.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:07.977+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:08.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:08.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:09.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:09.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:09.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:09.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:10.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:10.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:10.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:10.609+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:11.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:11.069+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:11.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:11.629+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:12.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:12.097+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:12.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:12.613+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:13.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:13.137+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:13.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:13.637+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:14.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:14.185+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:14.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:14.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:15.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:15.185+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:15.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:15.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:16.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:16.137+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:16.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:16.645+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:17.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:17.169+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:17.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:17.681+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:18.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:18.201+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:18.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:18.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:19.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:19.165+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:19.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:19.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:20.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:20.169+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:20.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:20.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:21.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:21.137+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:21.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:21.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:22.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:22.109+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:22.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:22.685+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:23.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:23.141+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:23.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:23.661+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:24.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:24.101+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:24.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:24.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:25.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:25.085+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:25.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:25.705+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:26.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:26.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:26.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:26.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:27.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:27.081+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:27.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:27.717+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:28.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:28.089+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:28.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:28.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:29.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:29.109+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:29.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:29.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:30.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:30.149+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:30.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:30.657+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:31.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:31.169+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:31.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:31.697+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:32.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:32.125+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:32.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:32.665+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:33.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:33.121+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:33.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:33.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:34.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:34.141+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:34.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:34.661+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:35.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:35.137+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:35.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:35.649+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:36.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:36.140+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:36.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:36.644+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:37.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:37.152+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:37.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:37.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:38.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:38.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:38.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:38.660+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:39.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:39.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:39.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:39.664+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:40.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:40.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:40.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:40.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:41.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:41.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:41.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:41.736+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:42.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:42.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:42.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:42.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:43.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:43.088+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:43.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:43.760+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:44.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:44.136+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:44.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:44.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:45.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:45.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:45.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:45.760+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:46.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:46.128+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:46.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:46.760+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:47.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:47.136+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:47.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:47.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:48.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:48.100+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:48.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:48.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:49.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:49.108+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:49.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:49.760+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:50.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:50.100+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:50.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:50.804+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:51.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:51.092+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:51.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:51.808+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:52.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:52.048+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:52.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:52.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:53.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:53.076+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:53.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:53.856+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:54.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:54.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:54.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:54.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:55.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:55.096+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:55.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:55.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:56.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:56.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:56.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:56.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:57.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:57.132+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:57.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:57.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:58.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:58.104+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:58.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:58.872+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:59.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:09:59.148+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:09:59.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:09:59.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:00.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:00.140+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:00.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:00.816+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:01.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:01.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:01.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:01.860+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:02.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:02.156+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:02.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:02.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:03.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:03.148+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:03.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:03.904+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:04.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:04.180+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:04.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:04.940+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:05.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:05.192+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:05.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:05.904+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:06.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:06.164+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:06.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:06.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:07.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:07.116+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:07.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:07.924+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:08.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:08.168+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:08.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:08.884+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:09.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:09.164+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:09.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:09.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:10.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:10.128+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:10.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:10.868+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:11.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:11.160+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:11.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:11.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:12.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:12.180+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:12.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:12.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:13.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:13.156+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:13.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:13.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:14.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:14.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:14.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:14.928+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:15.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:15.168+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:15.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:15.980+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:16.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:16.216+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:16.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:16.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:17.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:17.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:17.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:17.900+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:18.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:18.264+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:18.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:18.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:19.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:19.224+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:19.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:19.812+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:20.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:20.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:20.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:20.764+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:21.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:21.228+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:21.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:21.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:22.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:22.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:22.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:22.740+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:23.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:23.228+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:23.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:23.744+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:24.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:24.248+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:24.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:24.732+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:25.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:25.268+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:25.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:25.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:26.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:26.232+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:26.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:26.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:27.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:27.224+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:27.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:27.720+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:28.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:28.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:28.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:28.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:29.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:29.291+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:29.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:29.763+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:30.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:30.243+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:30.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:30.755+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:31.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:31.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:31.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:31.739+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:32.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:32.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:32.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:32.779+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:33.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:33.275+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:33.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:33.771+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:34.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:34.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:34.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:34.759+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:35.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:35.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:35.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:35.799+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:36.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:36.323+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:36.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:36.763+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:37.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:37.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:37.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:37.807+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:38.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:38.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:38.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:38.819+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:39.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:39.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:39.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:39.859+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:40.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:40.279+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:40.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:40.911+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:41.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:41.235+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:41.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:41.871+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:42.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:42.239+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:42.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:42.839+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:43.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:43.239+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:43.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:43.811+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:44.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:44.203+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:44.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:44.803+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:45.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:45.171+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:45.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:45.779+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:46.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:46.187+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:46.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:46.791+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:47.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:47.183+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:47.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:47.799+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:48.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:48.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:48.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:48.847+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:49.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:49.127+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:49.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:49.811+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:50.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:50.155+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:50.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:50.827+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:51.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:51.127+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:51.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:51.855+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:52.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:52.111+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:52.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:52.891+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:53.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:53.103+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:53.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:53.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:54.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:54.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:54.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:54.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:55.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:55.179+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:55.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:55.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:56.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:56.135+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:56.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:56.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:57.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:57.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:57.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:57.939+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:58.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:58.127+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:58.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:58.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:59.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:10:59.131+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:10:59.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:10:59.983+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:00.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:00.091+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:01.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:00.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:01.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:01.095+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:02.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:01.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:02.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:02.063+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:02.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:02.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:03.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:03.099+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:03.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:03.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:04.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:04.063+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:04.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:04.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:05.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:05.067+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:05.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:05.863+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:06.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:06.091+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:06.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:06.863+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:07.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:07.135+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:07.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:07.867+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:08.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:08.151+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:08.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:08.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:09.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:09.131+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:09.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:09.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:10.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:10.123+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:10.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:10.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:11.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:11.079+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:11.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:11.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:12.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:12.079+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:12.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:12.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:13.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:13.127+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:13.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:13.919+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:14.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:14.107+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:14.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:14.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:15.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:15.135+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:15.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:15.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:16.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:16.155+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:16.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:16.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:17.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:17.107+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:17.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:17.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:18.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:18.071+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:18.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:18.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:19.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:19.087+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:20.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:19.991+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:20.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:20.055+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:20.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:20.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:21.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:21.063+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:21.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:21.955+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:22.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:22.115+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:22.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:22.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:23.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:23.131+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:23.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:23.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:24.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:24.127+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:24.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:24.947+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:25.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:25.139+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:25.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:25.943+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:26.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:26.111+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:26.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:26.959+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:27.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:27.071+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:27.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:27.963+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:28.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:28.047+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:29.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:29.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:29.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:29.015+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:29.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:29.979+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:29.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:29.991+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:30.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:30.958+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:30.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:30.982+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:31.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:31.918+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:32.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:32.026+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:32.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:32.902+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:33.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:33.038+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:33.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:33.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:34.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:34.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:34.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:34.942+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:35.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:35.034+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:35.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:35.978+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:36.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:36.010+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:36.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:36.934+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:37.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:37.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:37.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:37.954+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:38.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:38.098+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:38.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:38.914+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:39.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:39.074+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:39.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:39.898+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:40.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:40.046+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:40.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:40.850+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:41.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:41.030+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:41.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:41.814+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:42.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:42.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:42.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:42.790+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:43.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:43.014+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:43.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:43.802+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:44.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:44.058+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:44.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:44.778+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:45.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:45.086+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:45.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:45.750+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:46.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:46.038+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:46.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:46.758+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:47.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:47.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:47.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:47.778+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:48.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:48.094+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:48.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:48.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:49.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:49.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:49.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:49.782+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:50.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:50.042+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:50.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:50.790+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:51.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:51.050+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:51.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:51.758+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:52.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:52.090+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:52.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:52.738+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:53.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:53.102+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:53.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:53.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:54.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:54.106+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:54.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:54.726+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:55.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:55.098+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:55.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:55.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:56.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:56.066+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:56.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:56.678+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:57.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:57.074+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:57.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:57.674+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:58.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:58.046+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:58.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:58.690+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:59.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:11:59.046+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:11:59.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:11:59.738+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:00.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:00.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:00.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:00.782+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:00.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:00.966+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:01.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:01.822+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:01.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:01.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:02.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:02.826+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:02.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:02.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:03.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:03.802+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:03.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:03.934+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:04.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:04.782+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:04.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:04.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:05.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:05.746+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:05.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:05.954+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:06.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:06.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:07.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:06.994+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:07.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:07.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:07.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:07.958+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:08.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:08.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:09.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:09.002+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:09.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:09.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:09.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:09.982+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:10.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:10.646+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:10.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:10.942+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:11.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:11.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:11.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:11.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:12.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:12.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:12.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:12.890+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:13.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:13.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:13.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:13.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:14.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:14.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:14.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:14.970+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:15.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:15.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:15.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:15.922+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:16.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:16.578+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:16.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:16.930+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:17.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:17.590+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:17.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:17.902+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:18.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:18.630+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:18.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:18.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:19.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:19.622+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:19.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:19.926+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:20.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:20.590+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:20.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:20.906+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:21.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:21.638+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:21.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:21.866+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:22.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:22.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:22.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:22.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:23.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:23.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:23.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:23.874+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:24.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:24.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:24.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:24.914+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:25.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:25.738+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:25.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:25.954+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:26.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:26.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:26.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:26.910+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:27.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:27.814+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:27.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:27.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:28.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:28.798+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:28.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:28.946+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:29.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:29.794+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:30.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:29.997+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:30.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:30.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:31.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:31.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:31.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:31.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:32.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:32.041+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:32.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:32.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:33.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:33.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:33.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:33.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:34.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:34.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:34.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:34.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:35.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:35.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:35.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:35.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:36.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:36.033+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:36.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:36.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:36.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:36.989+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:37.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:37.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:37.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:37.985+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:38.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:38.773+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:38.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:38.953+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:39.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:39.825+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:39.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:39.933+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:40.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:40.833+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:40.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:40.897+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:41.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:41.801+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:41.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:41.941+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:42.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:42.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:42.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:42.949+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:43.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:43.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:43.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:43.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:44.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:44.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:44.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:44.969+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:45.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:45.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:45.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:45.981+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:46.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:46.829+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:46.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:46.957+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:47.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:47.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:47.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:47.925+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:48.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:48.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:48.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:48.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:49.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:49.813+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:50.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:49.993+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:50.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:50.805+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:51.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:51.001+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:51.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:51.809+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:52.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:52.009+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:52.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:52.853+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:52.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:52.961+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:53.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:53.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:54.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:53.997+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:54.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:54.877+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:54.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:54.965+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:55.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:55.917+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:56.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:56.009+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:56.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:56.949+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:57.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:57.025+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:57.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:57.969+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:58.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:58.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:58.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:58.965+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:12:59.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:12:59.025+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:00.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:12:59.993+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:00.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:00.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:00.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:00.957+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:01.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:01.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:01.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:01.921+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:02.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:02.093+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:02.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:02.893+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:03.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:03.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:03.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:03.889+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:04.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:04.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:04.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:04.925+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:05.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:05.017+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:05.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:05.917+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:06.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:06.029+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:06.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:06.945+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:07.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:07.065+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:08.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:07.993+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:08.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:08.081+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:09.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:09.005+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:09.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:09.057+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:09.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:09.969+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:10.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:10.069+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:10.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:10.957+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:11.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:11.065+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:11.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:11.913+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:12.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:12.073+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:12.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:12.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:13.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:13.053+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:13.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:13.933+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:14.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:14.085+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:14.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:14.973+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:15.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:15.061+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:15.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:15.945+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:16.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:16.077+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:16.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:16.949+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:17.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:17.065+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:17.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:17.977+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:18.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:18.117+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:18.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:18.937+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:19.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:19.133+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:19.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:19.905+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:20.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:20.141+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:20.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:20.909+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:21.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:21.117+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:21.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:21.885+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:22.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:22.129+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:22.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:22.925+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:23.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:23.105+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:23.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:23.957+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:24.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:24.069+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:24.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:24.964+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:25.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:25.052+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:25.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:25.984+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:26.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:26.008+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:26.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:26.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:27.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:27.000+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:27.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:27.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:28.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:28.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:28.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:28.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:29.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:29.044+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:29.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:29.944+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:30.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:30.048+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:30.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:30.920+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:31.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:31.068+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:31.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:31.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:32.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:32.056+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:32.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:32.848+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:33.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:33.072+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:33.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:33.872+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:34.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:34.108+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:34.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:34.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:35.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:35.156+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:35.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:35.904+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:36.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:36.124+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:36.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:36.948+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:37.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:37.160+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:37.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:37.908+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:38.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:38.168+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:38.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:38.932+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:39.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:39.208+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:39.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:39.936+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:40.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:40.236+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:40.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:40.924+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:41.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:41.192+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:41.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:41.888+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:42.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:42.244+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:42.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:42.880+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:43.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:43.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:43.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:43.868+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:44.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:44.260+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:44.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:44.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:45.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:45.292+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:45.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:45.804+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:46.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:46.288+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:46.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:46.828+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:47.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:47.260+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:47.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:47.836+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:48.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:48.240+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:48.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:48.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:49.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:49.244+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:49.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:49.796+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:50.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:50.220+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:50.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:50.752+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:51.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:51.260+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:51.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:51.732+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:52.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:52.272+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:52.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:52.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:53.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:53.240+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:53.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:53.736+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:54.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:54.216+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:54.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:54.732+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:55.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:55.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:55.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:55.776+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:56.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:56.188+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:56.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:56.728+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:57.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:57.216+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:57.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:57.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:58.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:58.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:58.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:58.676+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:59.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:13:59.256+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:13:59.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:13:59.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:00.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:00.296+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:00.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:00.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:01.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:01.320+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:01.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:01.780+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:02.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:02.292+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:02.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:02.788+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:03.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:03.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:03.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:03.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:04.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:04.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:04.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:04.792+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:05.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:05.332+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:05.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:05.768+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:06.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:06.344+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:06.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:06.820+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:07.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:07.356+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:07.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:07.844+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:08.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:08.312+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:08.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:08.832+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:09.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:09.296+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:09.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:09.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:10.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:10.340+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:10.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:10.852+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:11.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:11.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:11.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:11.892+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:12.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:12.348+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:12.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:12.912+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:13.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:13.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:13.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:13.896+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:14.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:14.320+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:14.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:14.864+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:15.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:15.308+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:15.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:15.876+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:16.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:16.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:16.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:16.840+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:17.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:17.316+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:17.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:17.883+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:18.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:18.319+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:18.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:18.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:19.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:19.283+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:19.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:19.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:20.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:20.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:20.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:20.951+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:21.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:21.379+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:21.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:21.907+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:22.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:22.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:22.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:22.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:23.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:23.375+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:23.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:23.975+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:24.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:24.399+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:25.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:25.023+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:25.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:25.387+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:26.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:25.995+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:26.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:26.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:27.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:26.995+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:27.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:27.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:28.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:28.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:28.397 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:28.391+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:29.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:29.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:29.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:29.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:30.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:30.059+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:30.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:30.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:31.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:31.019+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:31.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:31.343+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:31.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:31.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:32.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:32.311+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:32.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:32.987+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:33.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:33.339+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:33.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:33.971+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:34.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:34.295+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:35.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:35.011+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:35.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:35.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:36.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:36.043+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:36.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:36.331+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:37.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:37.083+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:37.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:37.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:38.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:38.075+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:38.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:38.347+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:39.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:39.055+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:39.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:39.303+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:40.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:40.043+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:40.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:40.327+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:41.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:40.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:41.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:41.351+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:42.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:42.019+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:42.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:42.359+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:43.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:42.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:43.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:43.371+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:43.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:43.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:44.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:44.387+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:45.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:45.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:45.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:45.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:46.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:46.007+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:46.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:46.443+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:46.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:46.979+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:47.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:47.391+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:47.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:47.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:48.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:48.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:48.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:48.915+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:49.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:49.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:49.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:49.875+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:50.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:50.431+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:50.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:50.835+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:51.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:51.471+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:51.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:51.835+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:52.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:52.451+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:52.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:52.859+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:53.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:53.407+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:53.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:53.899+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:54.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:54.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:54.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:54.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:55.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:55.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:55.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:55.923+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:56.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:56.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:56.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:56.927+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:57.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:57.455+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:57.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:57.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:58.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:58.439+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:58.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:58.903+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:59.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:14:59.411+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:14:59.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:14:59.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:00.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:00.399+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:00.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:00.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:01.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:01.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:01.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:01.967+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:02.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:02.415+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:02.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:02.931+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:03.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:03.395+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:03.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:03.975+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:04.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:04.419+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:05.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:05.019+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:05.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:05.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:06.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:05.999+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:06.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:06.447+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:06.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:06.975+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:07.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:07.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:07.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:07.935+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:08.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:08.467+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:08.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:08.895+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:09.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:09.503+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:09.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:09.867+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:10.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:10.542+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:10.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:10.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:11.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:11.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:11.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:11.878+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:12.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:12.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:12.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:12.922+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:13.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:13.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:13.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:13.890+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:14.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:14.642+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:14.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:14.878+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:15.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:15.634+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:15.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:15.858+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:16.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:16.626+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:16.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:16.862+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:17.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:17.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:17.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:17.854+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:18.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:18.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:18.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:18.826+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:19.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:19.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:19.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:19.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:20.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:20.602+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:20.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:20.758+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:21.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:21.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:21.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:21.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:22.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:22.686+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:22.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:22.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:23.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:23.670+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:23.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:23.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:24.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:24.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:24.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:24.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:25.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:25.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:25.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:25.790+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:26.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:26.618+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:26.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:26.774+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:27.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:27.602+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:27.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:27.726+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:28.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:28.586+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:28.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:28.690+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:29.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:29.598+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:29.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:29.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:30.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:30.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:30.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:30.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:31.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:31.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:31.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:31.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:32.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:32.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:32.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:32.722+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:33.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:33.622+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:33.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:33.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:34.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:34.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:34.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:34.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:35.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:35.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:35.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:35.694+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:36.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:36.658+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:36.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:36.690+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:37.637 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:37.630+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:37.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:37.690+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:38.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:38.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:38.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:38.662+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:39.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:39.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:39.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:39.618+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:40.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:40.598+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:40.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:40.638+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:41.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:41.558+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:41.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:41.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:42.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:42.546+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:42.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:42.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:43.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:43.510+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:43.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:43.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:44.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:44.482+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:44.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:44.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:45.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:45.474+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:45.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:45.698+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:46.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:46.438+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:46.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:46.730+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:47.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:47.470+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:47.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:47.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:48.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:48.506+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:48.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:48.766+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:49.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:49.494+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:49.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:49.786+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:50.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:50.474+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:50.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:50.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:51.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:51.514+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:51.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:51.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:52.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:52.530+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:52.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:52.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:53.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:53.490+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:53.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:53.742+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:54.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:54.538+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:54.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:54.774+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:55.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:55.574+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:55.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:55.754+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:56.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:56.590+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:56.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:56.734+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:57.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:57.570+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:57.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:57.722+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:58.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:58.614+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:58.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:58.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:59.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:15:59.618+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:15:59.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:15:59.746+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:00.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:00.638+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:00.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:00.718+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:01.651 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:01.642+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:01.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:01.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:02.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:02.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:02.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:02.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:03.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:03.661+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:03.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:03.753+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:04.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:04.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:04.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:04.717+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:05.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:05.609+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:05.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:05.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:06.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:06.625+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:06.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:06.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:07.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:07.649+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:07.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:07.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:08.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:08.613+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:08.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:08.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:09.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:09.569+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:09.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:09.753+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:10.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:10.565+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:10.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:10.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:11.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:11.569+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:11.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:11.745+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:12.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:12.537+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:12.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:12.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:13.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:13.497+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:13.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:13.725+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:14.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:14.525+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:14.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:14.749+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:15.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:15.509+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:15.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:15.785+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:16.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:16.545+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:16.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:16.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:17.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:17.549+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:17.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:17.817+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:18.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:18.541+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:18.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:18.841+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:19.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:19.521+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:19.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:19.837+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:20.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:20.489+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:20.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:20.797+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:21.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:21.449+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:21.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:21.777+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:22.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:22.437+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:22.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:22.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:23.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:23.433+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:23.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:23.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:24.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:24.445+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:24.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:24.761+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:25.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:25.477+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:25.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:25.753+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:26.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:26.473+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:26.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:26.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:27.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:27.441+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:27.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:27.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:28.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:28.477+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:28.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:28.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:29.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:29.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:29.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:29.789+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:30.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:30.465+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:30.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:30.765+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:31.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:31.421+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:31.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:31.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:32.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:32.417+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:32.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:32.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:33.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:33.401+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:33.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:33.817+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:34.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:34.397+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:34.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:34.821+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:35.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:35.445+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:35.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:35.801+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:36.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:36.477+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:36.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:36.769+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:37.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:37.517+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:37.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:37.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:38.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:38.533+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:38.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:38.781+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:39.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:39.517+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:39.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:39.733+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:40.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:40.529+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:40.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:40.713+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:41.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:41.541+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:41.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:41.689+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:42.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:42.505+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:42.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:42.701+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:43.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:43.533+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:43.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:43.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:44.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:44.557+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:44.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:44.677+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:45.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:45.597+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:45.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:45.661+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:46.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:46.577+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:46.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:46.633+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:47.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:47.625+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:47.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:47.641+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:48.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:48.585+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:48.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:48.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:49.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:49.561+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:49.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:49.693+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:50.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:50.553+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:50.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:50.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:51.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:51.521+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:51.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:51.673+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:52.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:52.537+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:52.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:52.721+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:53.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:53.509+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:53.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:53.709+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:54.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:54.553+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:54.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:54.737+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:55.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:55.528+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:55.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:55.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:56.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:56.564+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:56.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:56.748+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:57.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:57.560+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:57.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:57.800+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:58.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:58.564+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:58.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:58.764+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:59.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:16:59.552+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:16:59.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:16:59.728+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:00.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:00.548+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:00.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:00.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:01.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:01.564+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:01.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:01.688+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:02.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:02.572+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:02.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:02.692+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:03.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:03.624+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:03.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:03.644+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:04.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:04.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:04.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:04.624+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:05.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:05.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:05.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:05.648+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:06.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:06.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:06.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:06.668+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:07.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:07.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:07.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:07.628+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:08.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:08.556+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:08.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:08.620+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:09.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:09.572+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:09.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:09.632+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:10.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:10.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:10.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:10.628+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:11.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:11.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:11.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:11.676+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:12.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:12.648+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:12.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:12.664+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:13.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:13.672+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:13.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:13.716+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:14.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:14.692+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:14.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:14.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:15.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:15.724+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:15.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:15.736+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:16.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:16.708+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:16.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:16.748+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:17.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:17.712+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:17.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:17.780+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:18.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:18.672+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:18.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:18.828+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:19.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:19.632+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:19.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:19.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:20.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:20.620+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:20.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:20.848+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:21.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:21.656+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:21.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:21.848+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:22.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:22.636+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:22.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:22.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:23.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:23.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:23.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:23.848+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:24.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:24.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:24.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:24.848+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:25.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:25.652+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:25.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:25.836+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:26.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:26.604+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:26.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:26.856+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:27.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:27.588+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:27.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:27.828+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:28.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:28.596+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:28.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:28.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:29.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:29.572+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:29.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:29.888+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:30.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:30.584+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:30.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:30.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:31.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:31.612+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:31.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:31.856+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:32.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:32.592+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:32.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:32.844+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:33.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:33.608+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:33.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:33.876+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:34.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:34.576+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:34.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:34.880+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:35.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:35.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:35.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:35.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:36.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:36.568+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:36.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:36.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:37.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:37.560+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:37.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:37.912+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:38.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:38.532+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:38.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:38.904+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:39.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:39.544+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:39.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:39.868+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:40.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:40.564+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:40.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:40.860+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:41.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:41.528+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:41.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:41.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:42.510 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:42.504+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:42.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:42.884+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:43.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:43.480+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:43.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:43.840+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:44.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:44.496+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:44.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:44.824+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:45.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:45.452+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:45.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:45.832+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:46.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:46.412+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:46.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:46.804+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:47.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:47.399+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:47.800 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:47.791+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:48.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:48.391+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:48.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:48.795+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:49.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:49.419+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:49.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:49.787+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:50.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:50.379+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:50.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:50.743+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:51.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:51.395+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:51.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:51.755+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:52.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:52.443+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:52.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:52.731+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:53.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:53.419+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:53.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:53.687+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:54.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:54.431+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:54.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:54.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:55.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:55.471+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:55.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:55.623+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:56.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:56.447+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:56.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:56.659+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:57.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:57.447+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:57.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:57.627+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:58.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:58.459+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:58.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:58.607+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:59.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:17:59.471+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:17:59.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:17:59.567+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:00.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:00.491+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:00.603 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:00.595+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:01.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:01.523+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:01.564 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:01.555+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:02.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:02.507+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:02.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:02.555+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:03.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:03.559+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:03.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:03.599+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:04.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:04.603+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:04.653 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:04.647+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:05.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:05.611+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:05.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:05.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:06.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:06.623+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:06.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:06.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:07.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:07.615+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:07.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:07.651+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:08.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:08.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:08.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:08.631+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:09.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:09.591+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:09.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:09.627+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:10.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:10.623+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:10.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:10.647+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:11.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:11.623+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:11.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:11.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:12.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:12.643+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:12.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:12.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:13.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:13.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:13.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:13.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:14.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:14.615+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:14.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:14.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:15.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:15.663+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:15.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:15.715+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:16.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:16.679+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:16.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:16.707+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:17.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:17.679+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:17.746 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:17.739+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:18.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:18.643+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:18.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:18.695+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:19.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:19.603+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:19.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:19.695+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:20.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:20.639+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:20.676 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:20.671+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:21.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:21.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:21.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:21.655+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:22.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:22.639+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:22.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:22.671+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:23.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:23.635+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:23.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:23.663+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:24.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:24.639+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:24.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:24.683+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:25.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:25.607+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:25.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:25.719+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:26.659 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:26.651+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:26.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:26.743+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:27.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:27.615+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:27.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:27.703+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:28.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:28.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:28.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:28.675+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:29.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:29.575+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:29.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:29.711+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:30.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:30.595+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:30.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:30.703+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:31.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:31.603+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:31.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:31.735+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:32.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:32.579+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:32.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:32.767+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:33.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:33.595+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:33.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:33.731+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:34.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:34.575+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:34.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:34.775+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:35.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:35.551+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:35.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:35.759+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:36.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:36.603+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:36.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:36.791+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:37.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:37.571+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:37.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:37.803+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:38.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:38.563+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:38.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:38.783+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:39.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:39.562+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:39.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:39.762+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:40.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:40.594+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:40.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:40.758+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:41.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:41.558+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:41.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:41.738+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:42.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:42.606+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:42.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:42.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:43.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:43.582+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:43.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:43.734+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:44.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:44.602+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:44.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:44.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:45.618 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:45.610+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:45.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:45.702+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:46.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:46.646+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:46.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:46.670+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:47.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:47.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:47.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:47.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:48.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:48.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:48.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:48.714+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:49.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:49.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:49.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:49.706+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:50.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:50.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:50.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:50.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:51.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:51.638+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:51.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:51.650+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:52.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:52.642+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:52.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:52.662+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:53.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:53.654+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:53.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:53.658+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:54.705 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:54.698+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:54.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:54.706+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:55.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:55.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:55.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:55.714+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:56.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:56.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:56.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:56.714+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:57.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:57.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:57.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:57.686+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:58.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:58.678+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:58.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:58.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:59.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:18:59.666+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:18:59.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:18:59.674+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:00.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:00.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:00.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:00.690+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:01.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:01.654+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:01.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:01.730+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:02.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:02.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:02.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:02.778+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:03.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:03.610+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:03.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:03.802+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:04.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:04.570+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:04.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:04.826+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:05.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:05.550+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:05.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:05.834+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:06.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:06.598+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:06.892 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:06.882+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:07.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:07.614+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:07.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:07.918+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:08.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:08.650+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:08.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:08.954+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:09.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:09.646+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:09.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:09.990+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:10.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:10.666+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:11.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:11.038+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:11.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:11.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:12.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:11.998+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:12.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:12.710+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:12.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:12.978+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:13.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:13.714+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:13.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:13.974+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:14.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:14.682+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:14.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:14.954+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:15.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:15.634+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:15.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:15.986+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:16.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:16.598+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:17.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:17.030+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:17.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:17.578+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:18.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:17.998+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:18.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:18.570+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:19.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:19.030+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:19.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:19.534+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:20.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:20.074+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:20.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:20.534+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:21.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:21.030+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:21.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:21.574+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:22.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:22.070+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:22.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:22.626+0000 7fd03e9ab700 -1 osd.0 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:23.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:23.026+0000 7fd339f70700 -1 osd.1 164 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:23.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:23.618+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:24.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:24.006+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:24.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:24.606+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:25.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:25.030+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:25.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:25.634+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:26.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:26.002+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:26.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:26.674+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:27.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:27.046+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:27.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:27.718+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:28.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:28.094+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:28.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:28.718+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:29.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:29.138+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:29.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:29.690+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:30.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:30.130+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:30.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:30.690+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:31.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:31.157+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:31.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:31.713+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:32.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:32.161+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:32.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:32.669+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:33.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:33.173+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:33.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:33.669+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:34.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:34.189+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:34.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:34.697+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:35.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:35.169+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:35.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:35.649+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:36.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:36.165+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:36.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:36.633+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:37.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:37.117+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:37.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:37.589+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:38.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:38.121+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:38.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:38.625+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:39.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:39.145+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:39.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:39.657+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:40.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:40.197+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:40.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:40.669+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:41.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:41.209+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:41.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:41.625+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:42.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:42.241+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:42.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:42.617+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:43.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:43.285+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:43.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:43.633+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:44.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:44.241+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:44.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:44.597+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:45.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:45.265+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:45.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:45.565+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:46.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:46.253+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:46.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:46.589+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:47.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:47.277+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:47.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:47.593+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:48.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:48.257+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:48.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:48.549+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:49.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:49.237+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:49.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:49.521+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:50.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:50.209+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:50.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:50.477+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:51.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:51.237+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:51.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:51.477+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:52.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:52.221+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:52.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:52.445+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:53.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:53.245+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:53.423 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:53.413+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:54.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:54.277+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:54.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:54.449+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:55.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:55.297+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:55.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:55.413+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:56.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:56.317+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:56.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:56.449+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:57.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:57.281+0000 7fd339f70700 -1 osd.1 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:57.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:57.461+0000 7fd03e9ab700 -1 osd.0 165 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:58.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:58.281+0000 7fd339f70700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:58.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:58.509+0000 7fd03e9ab700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:59.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:19:59.313+0000 7fd339f70700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:19:59.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:19:59.489+0000 7fd03e9ab700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:00.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:00.273+0000 7fd339f70700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:00.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:00.501+0000 7fd03e9ab700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:01.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:01.301+0000 7fd339f70700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:01.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:01.525+0000 7fd03e9ab700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:02.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:02.269+0000 7fd339f70700 -1 osd.1 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:02.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:02.489+0000 7fd03e9ab700 -1 osd.0 166 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:03.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:03.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:03.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:03.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:04.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:04.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:04.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:04.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:05.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:05.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:05.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:05.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:06.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:06.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:06.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:06.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:07.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:07.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:07.585 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:07.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:08.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:08.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:08.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:08.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:09.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:09.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:09.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:09.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:10.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:10.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:10.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:10.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:11.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:11.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:11.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:11.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:12.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:12.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:12.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:12.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:13.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:13.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:13.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:13.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:14.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:14.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:14.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:14.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:15.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:15.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:15.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:15.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:16.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:16.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:16.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:16.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:17.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:17.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:17.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:17.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:18.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:18.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:18.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:18.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:19.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:19.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:19.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:19.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:20.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:20.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:20.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:20.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:21.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:21.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:21.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:21.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:22.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:22.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:22.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:22.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:23.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:23.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:23.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:23.552+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:24.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:24.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:24.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:24.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:24.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:24.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:25.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:25.472+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:26.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:26.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:26.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:26.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:27.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:27.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:27.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:27.428+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:28.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:28.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:28.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:28.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:29.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:29.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:29.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:29.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:30.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:30.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:30.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:30.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:31.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:31.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:31.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:31.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:32.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:32.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:32.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:32.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:33.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:33.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:33.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:33.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:34.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:34.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:34.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:34.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:35.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:35.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:35.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:35.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:36.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:36.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:36.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:36.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:37.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:37.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:37.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:37.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:38.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:38.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:38.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:38.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:39.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:39.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:39.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:39.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:40.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:40.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:40.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:40.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:41.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:41.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:41.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:41.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:42.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:42.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:42.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:42.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:43.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:43.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:43.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:43.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:44.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:44.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:44.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:44.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:45.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:45.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:45.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:45.368+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:46.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:46.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:46.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:46.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:47.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:47.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:47.395 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:47.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:48.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:48.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:48.361 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:48.356+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:49.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:49.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:49.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:49.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:50.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:50.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:50.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:50.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:51.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:51.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:51.319 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:51.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:51.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:51.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:52.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:52.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:53.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:53.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:53.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:53.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:54.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:54.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:54.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:54.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:55.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:55.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:55.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:55.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:56.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:56.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:56.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:56.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:57.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:57.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:57.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:57.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:58.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:58.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:58.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:58.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:59.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:59.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:20:59.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:20:59.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:00.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:20:59.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:00.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:00.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:01.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:01.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:01.298 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:01.292+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:02.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:02.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:02.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:02.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:03.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:03.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:03.280 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:03.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:04.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:04.076+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:04.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:04.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:05.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:05.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:05.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:05.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:06.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:06.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:06.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:06.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:07.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:07.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:07.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:07.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:08.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:08.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:08.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:08.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:09.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:09.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:09.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:09.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:10.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:10.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:10.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:10.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:11.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:11.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:11.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:11.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:12.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:12.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:12.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:12.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:13.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:13.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:13.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:13.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:14.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:14.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:14.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:14.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:15.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:15.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:15.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:15.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:16.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:16.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:16.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:16.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:17.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:17.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:17.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:17.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:18.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:18.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:18.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:18.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:19.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:19.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:19.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:19.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:20.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:20.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:20.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:20.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:21.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:21.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:21.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:21.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:22.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:22.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:22.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:22.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:23.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:23.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:23.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:23.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:24.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:24.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:24.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:24.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:25.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:25.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:25.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:25.355+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:26.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:25.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:26.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:26.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:27.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:27.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:27.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:27.383+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:28.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:28.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:28.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:28.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:29.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:29.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:29.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:29.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:30.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:30.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:30.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:30.295+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:31.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:31.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:31.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:31.251+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:32.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:32.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:32.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:32.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:33.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:33.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:33.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:33.295+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:33.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:33.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:34.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:34.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:35.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:35.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:35.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:35.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:36.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:36.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:36.300 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:36.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:37.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:37.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:37.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:37.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:38.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:38.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:38.300 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:38.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:39.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:39.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:39.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:39.247+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:40.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:40.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:40.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:40.227+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:41.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:41.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:41.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:41.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:42.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:42.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:42.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:42.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:43.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:43.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:43.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:43.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:44.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:44.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:44.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:44.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:45.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:45.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:45.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:45.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:46.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:46.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:46.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:46.319+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:47.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:47.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:47.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:47.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:48.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:48.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:48.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:48.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:49.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:49.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:49.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:49.423+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:50.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:50.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:50.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:50.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:51.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:51.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:51.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:51.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:52.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:52.131+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:52.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:52.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:53.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:53.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:53.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:53.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:54.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:54.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:54.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:54.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:55.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:55.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:55.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:55.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:56.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:56.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:56.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:56.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:57.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:57.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:57.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:57.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:58.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:58.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:58.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:58.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:59.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:21:59.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:21:59.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:21:59.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:00.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:00.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:00.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:00.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:01.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:01.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:01.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:01.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:02.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:02.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:02.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:02.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:03.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:03.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:03.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:03.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:04.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:04.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:04.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:04.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:05.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:05.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:05.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:05.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:06.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:06.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:06.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:06.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:07.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:07.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:07.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:07.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:08.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:08.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:08.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:08.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:09.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:09.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:09.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:09.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:10.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:10.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:10.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:10.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:11.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:11.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:11.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:11.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:12.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:12.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:12.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:12.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:13.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:13.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:13.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:13.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:14.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:14.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:14.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:14.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:15.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:15.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:15.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:15.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:16.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:16.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:16.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:16.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:17.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:17.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:17.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:17.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:18.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:18.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:18.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:18.510+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:19.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:19.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:19.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:19.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:20.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:20.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:20.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:20.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:21.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:21.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:21.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:21.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:22.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:22.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:22.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:22.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:23.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:23.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:23.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:23.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:24.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:24.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:24.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:24.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:25.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:25.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:25.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:25.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:26.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:26.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:26.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:26.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:27.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:27.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:27.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:27.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:28.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:28.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:28.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:28.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:29.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:29.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:29.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:29.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:30.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:30.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:30.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:30.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:31.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:31.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:31.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:31.634+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:32.358 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:32.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:32.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:32.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:33.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:33.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:33.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:33.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:34.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:34.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:34.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:34.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:35.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:35.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:35.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:35.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:36.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:36.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:36.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:36.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:37.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:37.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:37.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:37.670+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:38.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:38.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:38.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:38.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:39.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:39.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:39.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:39.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:40.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:40.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:40.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:40.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:41.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:41.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:41.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:41.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:42.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:42.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:42.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:42.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:43.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:43.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:43.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:43.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:44.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:44.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:44.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:44.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:45.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:45.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:45.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:45.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:46.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:46.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:46.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:46.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:47.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:47.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:47.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:47.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:48.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:48.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:48.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:48.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:49.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:49.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:49.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:49.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:50.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:50.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:50.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:50.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:51.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:51.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:51.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:51.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:52.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:52.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:52.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:52.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:53.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:53.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:53.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:53.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:54.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:54.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:54.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:54.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:55.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:55.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:55.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:55.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:56.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:56.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:56.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:56.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:57.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:57.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:57.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:57.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:58.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:58.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:58.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:58.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:59.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:22:59.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:22:59.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:22:59.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:00.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:00.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:00.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:00.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:01.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:01.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:01.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:01.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:02.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:02.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:02.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:02.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:03.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:03.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:03.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:03.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:04.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:04.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:04.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:04.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:05.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:05.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:05.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:05.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:06.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:06.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:06.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:06.745+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:07.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:07.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:07.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:07.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:08.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:08.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:08.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:08.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:09.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:09.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:09.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:09.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:10.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:10.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:10.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:10.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:11.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:11.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:11.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:11.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:12.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:12.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:12.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:12.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:13.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:13.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:13.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:13.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:14.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:14.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:14.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:14.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:15.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:15.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:15.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:15.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:16.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:16.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:16.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:16.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:17.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:17.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:17.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:17.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:18.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:18.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:18.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:18.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:19.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:19.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:19.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:19.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:20.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:20.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:20.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:20.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:21.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:21.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:21.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:21.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:22.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:22.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:22.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:22.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:23.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:23.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:23.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:23.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:24.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:24.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:24.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:24.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:25.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:25.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:25.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:25.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:26.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:26.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:26.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:26.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:27.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:27.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:27.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:27.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:28.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:28.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:28.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:28.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:29.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:29.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:29.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:29.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:30.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:30.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:30.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:30.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:31.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:31.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:31.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:31.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:32.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:32.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:32.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:32.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:33.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:33.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:33.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:33.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:34.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:34.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:34.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:34.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:35.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:35.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:35.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:35.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:36.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:36.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:36.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:36.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:37.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:37.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:37.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:37.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:38.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:38.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:38.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:38.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:39.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:39.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:39.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:39.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:40.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:40.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:40.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:40.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:41.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:41.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:41.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:41.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:42.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:42.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:42.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:42.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:43.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:43.537+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:43.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:43.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:44.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:44.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:44.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:44.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:45.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:45.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:45.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:45.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:46.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:46.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:46.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:46.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:47.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:47.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:47.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:47.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:48.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:48.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:49.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:49.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:49.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:49.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:50.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:50.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:50.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:50.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:51.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:51.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:51.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:51.412+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:52.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:52.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:52.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:52.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:53.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:53.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:53.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:53.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:54.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:54.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:54.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:54.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:55.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:55.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:55.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:55.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:56.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:56.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:56.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:56.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:57.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:57.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:57.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:57.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:58.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:58.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:58.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:58.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:59.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:23:59.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:23:59.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:23:59.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:00.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:00.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:00.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:00.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:01.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:01.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:01.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:01.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:02.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:02.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:02.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:02.400+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:03.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:03.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:03.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:03.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:04.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:04.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:04.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:04.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:05.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:05.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:05.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:05.388+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:06.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:06.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:06.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:06.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:07.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:07.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:07.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:07.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:08.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:08.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:08.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:08.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:09.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:09.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:09.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:09.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:10.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:10.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:10.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:10.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:11.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:11.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:11.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:11.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:12.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:12.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:12.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:12.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:13.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:13.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:13.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:13.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:14.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:14.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:14.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:14.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:15.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:15.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:15.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:15.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:16.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:16.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:16.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:16.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:17.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:17.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:17.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:17.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:18.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:18.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:18.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:18.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:19.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:19.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:19.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:19.276+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:20.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:20.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:20.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:20.276+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:21.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:21.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:21.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:21.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:22.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:22.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:22.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:22.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:23.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:22.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:23.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:23.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:24.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:23.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:24.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:24.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:25.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:25.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:25.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:25.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:26.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:26.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:26.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:26.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:27.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:27.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:27.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:27.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:28.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:28.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:28.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:28.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:29.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:29.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:29.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:29.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:30.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:30.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:30.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:30.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:31.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:31.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:31.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:31.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:32.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:32.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:32.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:32.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:32.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:32.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:33.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:33.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:34.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:34.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:34.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:34.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:34.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:34.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:35.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:35.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:35.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:35.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:36.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:36.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:36.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:36.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:37.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:37.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:38.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:38.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:38.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:38.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:39.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:39.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:39.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:39.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:40.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:40.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:40.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:40.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:41.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:41.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:41.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:41.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:42.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:42.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:42.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:42.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:42.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:42.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:43.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:43.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:43.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:43.987+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:44.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:44.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:44.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:44.983+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:45.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:45.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:46.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:46.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:46.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:46.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:47.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:47.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:47.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:47.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:48.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:48.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:48.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:48.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:49.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:49.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:49.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:49.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:50.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:50.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:50.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:50.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:51.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:51.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:51.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:51.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:52.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:52.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:52.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:52.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:53.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:53.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:53.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:53.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:54.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:54.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:54.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:54.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:55.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:55.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:55.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:55.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:56.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:56.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:56.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:56.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:57.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:57.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:57.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:57.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:58.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:58.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:58.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:58.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:59.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:24:59.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:24:59.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:24:59.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:00.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:00.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:00.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:00.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:01.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:01.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:01.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:01.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:02.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:02.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:02.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:02.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:03.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:03.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:03.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:03.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:03.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:03.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:04.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:04.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:04.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:04.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:05.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:05.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:05.974 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:05.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:06.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:06.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:07.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:06.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:07.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:07.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:07.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:07.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:08.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:08.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:08.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:08.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:09.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:09.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:10.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:10.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:10.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:10.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:11.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:10.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:11.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:11.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:11.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:11.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:12.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:12.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:12.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:12.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:13.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:13.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:13.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:13.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:14.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:14.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:14.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:14.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:15.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:15.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:15.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:15.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:16.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:16.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:16.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:16.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:17.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:17.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:17.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:17.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:18.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:18.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:18.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:18.987+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:19.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:19.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:20.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:20.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:20.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:20.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:21.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:21.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:21.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:21.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:22.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:22.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:22.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:22.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:23.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:23.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:23.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:23.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:24.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:24.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:24.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:24.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:25.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:25.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:25.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:25.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:26.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:26.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:26.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:26.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:27.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:27.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:27.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:27.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:28.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:27.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:28.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:28.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:29.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:29.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:29.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:29.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:30.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:30.038+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:30.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:30.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:31.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:31.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:31.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:31.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:32.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:32.058+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:32.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:32.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:33.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:33.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:33.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:33.162+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:34.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:33.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:34.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:34.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:34.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:34.978+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:35.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:35.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:36.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:36.002+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:36.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:36.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:36.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:36.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:37.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:37.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:37.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:37.990+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:38.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:38.162+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:38.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:38.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:39.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:39.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:40.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:39.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:40.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:40.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:40.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:40.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:41.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:41.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:41.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:41.986+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:42.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:42.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:43.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:43.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:43.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:43.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:44.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:44.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:44.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:44.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:45.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:45.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:45.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:45.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:46.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:46.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:46.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:46.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:47.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:47.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:47.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:47.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:48.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:48.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:48.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:48.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:49.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:49.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:49.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:49.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:50.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:50.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:50.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:50.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:51.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:51.070+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:51.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:51.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:52.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:52.086+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:52.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:52.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:53.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:53.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:53.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:53.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:54.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:54.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:54.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:54.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:55.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:55.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:55.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:55.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:56.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:56.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:56.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:56.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:57.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:57.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:57.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:57.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:58.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:58.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:58.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:58.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:59.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:25:59.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:25:59.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:25:59.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:00.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:00.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:00.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:00.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:01.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:01.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:01.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:01.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:02.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:02.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:02.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:02.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:03.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:03.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:03.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:03.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:04.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:04.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:04.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:04.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:05.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:05.174+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:05.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:05.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:06.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:06.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:06.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:06.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:07.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:07.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:07.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:07.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:08.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:08.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:08.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:08.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:09.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:09.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:09.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:09.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:10.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:10.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:10.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:10.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:11.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:11.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:11.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:11.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:12.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:12.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:12.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:12.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:13.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:13.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:13.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:13.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:14.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:14.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:14.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:14.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:15.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:15.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:15.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:15.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:16.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:16.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:16.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:16.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:17.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:17.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:17.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:17.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:18.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:18.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:18.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:18.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:19.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:19.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:19.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:19.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:20.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:20.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:20.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:20.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:21.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:21.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:21.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:21.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:22.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:22.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:22.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:22.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:23.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:23.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:23.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:23.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:24.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:24.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:24.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:24.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:25.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:25.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:25.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:25.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:26.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:26.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:26.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:26.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:27.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:27.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:27.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:27.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:28.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:28.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:28.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:28.345+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:29.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:29.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:29.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:29.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:30.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:30.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:30.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:30.337+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:31.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:31.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:31.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:31.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:32.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:32.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:32.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:32.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:33.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:33.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:33.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:33.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:34.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:34.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:34.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:34.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:35.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:35.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:35.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:35.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:36.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:36.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:36.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:36.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:37.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:37.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:37.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:37.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:38.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:38.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:38.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:38.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:39.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:39.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:39.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:39.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:40.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:40.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:40.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:40.349+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:41.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:41.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:41.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:41.389+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:42.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:42.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:42.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:42.405+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:43.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:43.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:43.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:43.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:44.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:44.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:44.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:44.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:45.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:45.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:45.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:45.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:46.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:46.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:46.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:46.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:47.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:47.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:47.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:47.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:48.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:48.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:48.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:48.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:49.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:49.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:49.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:49.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:50.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:50.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:50.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:50.345+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:51.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:51.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:51.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:51.377+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:52.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:52.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:52.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:52.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:53.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:53.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:53.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:53.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:54.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:54.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:54.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:54.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:55.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:55.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:55.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:55.333+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:56.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:56.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:56.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:56.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:57.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:57.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:57.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:57.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:58.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:58.293+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:58.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:58.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:59.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:26:59.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:26:59.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:26:59.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:00.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:00.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:00.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:00.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:01.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:01.273+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:01.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:01.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:02.270 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:02.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:02.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:02.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:03.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:03.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:03.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:03.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:04.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:04.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:04.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:04.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:05.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:05.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:05.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:05.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:06.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:06.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:06.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:06.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:07.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:07.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:07.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:07.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:08.266 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:08.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:08.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:08.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:09.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:09.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:09.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:09.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:10.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:10.321+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:10.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:10.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:11.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:11.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:11.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:11.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:12.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:12.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:12.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:12.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:13.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:13.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:13.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:13.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:14.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:14.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:14.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:14.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:15.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:15.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:15.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:15.388+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:16.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:16.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:16.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:16.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:17.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:17.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:17.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:17.424+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:18.388 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:18.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:18.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:18.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:19.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:19.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:19.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:19.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:20.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:20.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:20.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:20.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:21.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:21.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:21.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:21.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:22.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:22.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:22.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:22.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:23.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:23.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:23.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:23.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:24.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:24.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:24.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:24.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:25.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:25.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:25.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:25.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:26.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:26.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:26.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:26.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:27.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:27.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:27.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:27.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:28.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:28.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:28.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:28.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:29.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:29.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:29.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:29.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:30.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:30.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:30.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:30.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:31.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:31.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:31.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:31.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:32.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:32.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:32.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:32.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:33.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:33.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:33.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:33.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:34.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:34.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:34.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:34.424+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:35.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:35.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:35.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:35.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:36.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:36.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:36.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:36.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:37.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:37.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:37.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:37.384+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:38.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:38.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:38.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:38.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:39.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:39.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:39.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:39.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:40.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:40.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:40.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:40.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:41.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:41.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:41.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:41.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:42.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:42.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:42.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:42.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:43.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:43.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:43.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:43.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:44.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:44.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:44.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:44.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:45.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:45.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:45.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:45.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:46.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:46.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:46.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:46.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:47.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:47.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:47.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:47.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:48.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:48.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:48.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:48.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:49.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:49.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:49.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:49.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:50.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:50.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:50.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:50.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:51.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:51.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:51.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:51.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:52.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:52.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:52.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:52.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:53.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:53.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:53.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:53.516+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:54.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:54.192+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:54.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:54.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:55.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:55.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:55.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:55.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:56.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:56.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:56.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:56.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:57.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:57.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:57.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:57.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:58.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:58.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:58.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:58.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:59.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:27:59.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:27:59.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:27:59.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:00.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:00.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:00.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:00.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:01.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:01.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:01.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:01.412+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:02.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:02.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:02.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:02.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:03.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:03.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:03.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:03.436+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:04.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:04.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:04.397 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:04.392+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:05.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:05.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:05.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:05.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:06.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:06.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:06.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:06.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:07.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:07.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:07.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:07.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:08.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:08.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:08.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:08.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:09.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:09.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:09.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:09.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:10.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:10.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:10.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:10.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:11.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:11.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:11.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:11.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:12.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:12.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:12.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:12.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:13.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:13.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:13.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:13.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:14.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:14.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:14.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:14.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:15.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:15.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:15.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:15.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:16.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:16.275+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:16.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:16.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:17.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:17.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:17.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:17.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:18.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:18.331+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:18.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:18.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:19.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:19.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:19.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:19.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:20.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:20.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:20.361 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:20.355+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:21.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:21.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:21.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:21.383+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:22.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:22.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:22.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:22.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:23.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:23.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:23.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:23.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:24.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:24.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:24.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:24.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:25.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:25.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:25.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:25.423+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:26.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:26.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:26.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:26.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:27.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:27.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:27.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:27.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:28.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:28.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:28.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:28.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:29.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:29.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:29.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:29.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:30.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:30.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:30.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:30.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:31.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:31.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:31.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:31.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:32.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:32.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:32.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:32.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:33.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:33.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:33.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:33.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:34.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:34.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:34.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:34.355+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:35.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:35.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:35.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:35.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:36.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:36.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:36.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:36.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:37.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:37.095+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:37.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:37.387+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:38.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:38.131+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:38.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:38.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:39.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:39.095+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:39.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:39.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:40.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:40.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:40.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:40.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:41.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:41.131+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:41.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:41.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:42.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:42.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:42.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:42.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:43.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:43.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:43.430 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:43.423+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:44.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:44.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:44.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:44.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:45.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:45.175+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:45.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:45.423+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:46.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:46.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:46.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:46.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:47.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:47.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:47.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:47.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:48.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:48.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:48.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:48.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:49.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:49.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:49.486 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:49.479+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:50.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:50.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:50.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:50.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:51.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:51.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:51.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:51.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:52.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:52.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:52.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:52.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:53.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:53.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:53.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:53.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:54.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:54.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:54.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:54.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:55.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:55.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:55.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:55.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:56.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:56.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:56.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:56.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:57.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:57.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:57.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:57.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:58.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:58.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:58.454 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:58.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:59.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:28:59.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:28:59.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:28:59.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:00.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:00.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:00.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:00.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:01.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:01.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:01.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:01.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:02.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:02.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:02.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:02.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:03.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:03.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:03.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:03.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:04.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:04.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:04.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:04.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:05.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:05.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:05.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:05.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:06.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:06.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:06.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:06.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:07.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:07.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:07.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:07.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:08.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:08.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:08.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:08.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:09.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:09.382+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:09.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:09.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:10.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:10.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:10.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:10.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:11.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:11.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:11.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:11.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:12.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:12.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:12.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:12.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:13.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:13.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:13.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:13.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:14.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:14.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:14.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:14.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:15.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:15.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:15.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:15.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:16.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:16.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:16.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:16.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:17.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:17.394+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:17.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:17.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:18.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:18.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:18.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:18.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:19.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:19.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:19.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:19.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:20.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:20.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:20.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:20.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:21.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:21.410+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:21.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:21.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:22.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:22.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:22.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:22.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:23.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:23.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:23.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:23.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:24.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:24.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:24.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:24.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:25.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:25.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:25.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:25.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:26.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:26.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:26.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:26.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:27.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:27.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:27.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:27.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:28.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:28.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:28.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:28.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:29.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:29.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:29.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:29.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:30.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:30.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:30.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:30.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:31.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:31.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:31.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:31.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:32.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:32.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:32.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:32.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:33.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:33.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:33.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:33.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:34.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:34.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:34.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:34.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:35.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:35.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:35.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:35.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:36.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:36.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:36.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:36.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:37.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:37.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:37.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:37.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:38.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:38.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:38.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:38.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:39.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:39.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:39.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:39.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:40.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:40.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:40.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:40.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:41.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:41.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:41.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:41.786+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:42.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:42.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:42.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:42.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:43.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:43.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:43.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:43.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:44.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:44.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:44.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:44.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:45.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:45.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:45.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:45.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:46.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:46.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:46.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:46.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:47.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:47.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:47.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:47.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:48.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:48.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:48.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:48.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:49.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:49.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:49.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:49.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:50.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:50.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:50.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:50.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:51.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:51.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:51.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:51.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:52.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:52.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:52.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:52.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:53.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:53.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:53.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:53.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:54.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:54.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:54.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:54.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:55.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:55.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:55.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:55.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:56.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:56.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:56.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:56.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:57.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:57.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:57.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:57.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:58.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:58.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:58.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:58.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:59.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:29:59.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:29:59.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:29:59.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:00.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:00.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:00.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:00.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:01.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:01.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:01.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:01.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:02.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:02.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:02.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:02.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:03.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:03.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:03.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:03.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:04.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:04.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:04.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:04.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:05.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:05.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:05.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:05.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:06.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:06.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:06.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:06.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:07.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:07.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:07.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:07.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:08.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:08.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:08.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:08.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:09.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:09.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:09.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:09.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:10.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:10.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:10.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:10.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:11.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:11.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:11.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:11.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:12.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:12.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:12.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:12.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:13.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:13.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:13.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:13.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:14.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:14.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:14.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:14.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:15.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:15.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:15.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:15.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:16.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:16.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:16.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:16.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:17.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:17.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:17.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:17.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:18.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:18.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:18.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:18.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:19.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:19.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:19.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:19.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:20.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:20.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:20.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:20.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:21.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:21.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:21.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:21.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:22.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:22.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:22.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:22.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:23.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:23.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:23.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:23.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:24.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:24.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:24.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:24.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:25.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:25.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:25.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:25.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:26.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:26.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:26.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:26.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:27.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:27.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:27.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:27.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:28.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:28.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:28.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:28.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:29.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:29.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:29.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:29.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:30.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:30.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:30.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:30.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:31.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:31.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:31.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:31.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:32.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:32.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:32.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:32.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:33.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:33.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:33.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:33.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:34.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:34.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:34.574 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:34.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:35.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:35.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:35.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:35.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:36.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:36.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:36.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:36.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:37.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:37.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:37.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:37.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:38.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:38.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:38.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:38.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:39.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:39.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:39.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:39.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:40.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:40.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:40.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:40.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:41.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:41.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:41.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:41.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:42.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:42.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:42.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:42.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:43.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:43.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:43.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:43.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:44.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:44.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:44.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:44.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:45.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:45.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:45.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:45.564+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:46.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:46.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:46.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:46.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:47.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:47.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:47.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:47.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:48.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:48.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:48.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:48.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:49.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:49.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:49.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:49.532+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:50.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:50.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:50.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:50.564+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:51.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:51.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:51.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:51.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:52.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:52.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:52.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:52.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:53.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:53.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:53.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:53.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:54.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:54.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:54.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:54.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:55.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:55.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:55.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:55.552+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:56.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:56.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:56.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:56.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:57.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:57.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:57.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:57.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:58.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:58.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:58.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:58.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:59.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:30:59.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:30:59.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:30:59.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:00.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:00.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:00.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:00.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:01.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:01.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:01.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:01.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:02.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:02.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:02.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:02.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:03.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:03.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:03.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:03.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:04.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:04.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:04.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:04.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:05.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:05.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:05.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:05.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:06.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:06.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:06.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:06.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:07.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:07.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:07.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:07.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:08.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:08.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:08.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:08.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:09.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:09.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:09.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:09.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:10.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:10.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:10.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:10.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:11.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:11.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:11.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:11.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:12.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:12.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:12.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:12.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:13.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:13.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:13.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:13.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:14.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:13.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:14.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:14.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:15.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:15.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:15.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:15.780+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:16.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:16.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:16.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:16.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:17.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:17.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:17.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:17.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:18.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:18.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:18.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:18.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:19.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:19.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:19.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:19.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:20.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:20.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:20.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:20.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:21.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:21.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:21.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:21.832+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:22.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:22.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:22.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:22.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:23.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:23.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:23.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:23.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:24.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:24.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:24.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:24.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:25.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:25.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:25.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:25.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:26.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:26.276+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:26.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:26.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:27.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:27.312+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:27.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:27.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:28.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:28.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:28.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:28.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:29.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:29.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:29.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:29.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:30.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:30.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:30.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:30.940+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:31.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:31.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:31.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:31.936+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:32.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:32.384+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:32.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:32.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:33.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:33.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:33.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:33.868+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:34.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:34.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:34.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:34.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:35.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:35.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:35.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:35.936+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:36.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:36.384+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:36.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:36.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:37.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:37.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:37.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:37.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:38.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:38.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:38.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:38.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:39.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:39.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:39.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:39.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:40.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:40.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:40.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:40.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:41.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:41.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:41.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:41.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:42.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:42.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:42.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:42.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:43.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:43.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:43.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:43.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:44.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:44.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:45.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:44.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:45.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:45.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:45.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:45.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:46.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:46.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:46.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:46.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:47.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:47.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:47.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:47.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:48.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:48.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:48.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:48.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:49.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:49.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:49.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:49.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:50.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:50.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:50.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:50.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:51.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:51.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:51.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:51.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:52.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:52.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:52.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:52.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:53.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:53.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:53.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:53.883+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:54.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:54.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:54.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:54.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:55.358 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:55.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:55.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:55.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:56.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:56.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:56.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:56.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:57.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:57.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:57.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:57.819+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:58.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:58.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:58.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:58.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:59.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:31:59.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:31:59.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:31:59.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:00.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:00.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:00.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:00.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:01.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:01.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:01.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:01.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:02.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:02.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:02.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:02.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:03.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:03.407+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:03.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:03.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:04.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:04.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:04.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:04.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:05.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:05.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:05.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:05.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:06.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:06.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:06.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:06.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:07.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:07.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:07.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:07.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:08.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:08.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:08.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:08.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:09.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:09.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:09.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:09.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:10.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:10.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:10.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:10.819+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:11.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:11.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:11.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:11.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:12.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:12.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:12.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:12.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:13.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:13.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:13.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:13.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:14.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:14.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:14.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:14.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:15.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:15.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:15.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:15.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:16.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:16.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:16.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:16.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:17.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:17.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:17.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:17.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:18.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:18.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:18.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:18.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:19.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:19.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:19.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:19.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:20.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:20.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:20.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:20.767+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:21.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:21.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:21.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:21.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:22.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:22.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:22.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:22.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:23.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:23.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:23.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:23.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:24.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:24.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:24.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:24.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:25.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:25.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:25.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:25.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:26.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:26.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:26.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:26.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:27.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:27.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:27.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:27.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:28.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:28.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:28.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:28.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:29.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:29.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:29.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:29.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:30.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:30.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:30.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:30.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:31.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:31.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:31.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:31.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:32.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:32.410+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:32.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:32.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:33.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:33.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:33.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:33.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:34.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:34.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:34.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:34.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:35.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:35.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:35.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:35.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:36.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:36.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:36.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:36.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:37.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:37.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:37.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:37.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:38.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:38.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:38.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:38.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:39.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:39.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:39.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:39.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:40.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:40.534+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:40.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:40.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:41.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:41.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:41.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:41.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:42.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:42.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:42.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:42.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:43.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:43.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:43.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:43.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:44.652 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:44.642+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:44.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:44.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:45.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:45.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:45.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:45.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:46.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:46.658+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:46.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:46.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:47.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:47.658+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:47.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:47.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:48.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:48.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:48.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:48.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:49.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:49.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:49.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:49.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:50.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:50.610+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:50.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:50.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:51.611 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:51.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:51.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:51.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:52.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:52.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:52.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:52.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:53.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:53.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:53.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:53.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:54.564 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:54.554+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:54.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:54.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:55.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:55.510+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:55.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:55.918+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:56.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:56.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:56.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:56.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:57.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:57.534+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:57.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:57.922+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:58.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:58.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:58.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:32:58.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:32:59.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:32:59.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:00.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:00.006+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:00.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:00.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:00.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:00.986+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:01.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:01.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:02.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:02.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:02.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:02.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:03.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:03.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:03.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:03.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:04.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:04.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:04.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:04.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:05.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:05.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:05.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:05.674+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:06.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:06.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:06.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:06.674+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:07.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:07.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:07.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:07.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:08.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:08.178+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:08.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:08.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:09.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:09.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:09.641 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:09.634+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:10.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:10.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:10.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:10.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:11.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:11.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:11.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:11.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:12.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:12.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:12.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:12.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:13.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:13.174+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:13.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:13.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:14.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:14.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:14.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:14.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:15.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:15.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:15.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:15.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:16.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:16.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:16.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:16.690+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:17.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:17.238+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:17.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:17.658+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:18.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:18.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:18.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:18.698+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:19.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:19.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:19.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:19.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:20.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:20.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:20.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:20.634+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:21.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:21.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:21.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:21.609+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:22.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:22.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:22.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:22.613+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:23.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:23.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:23.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:23.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:24.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:24.153+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:24.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:24.537+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:25.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:25.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:25.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:25.585+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:26.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:26.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:26.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:26.617+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:27.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:27.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:27.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:27.617+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:28.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:28.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:28.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:28.653+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:29.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:29.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:29.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:29.665+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:30.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:30.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:30.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:30.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:31.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:31.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:31.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:31.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:32.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:32.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:32.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:32.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:33.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:33.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:33.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:33.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:34.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:34.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:34.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:34.669+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:35.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:35.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:35.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:35.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:36.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:36.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:36.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:36.685+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:37.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:37.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:37.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:37.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:38.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:38.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:38.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:38.749+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:39.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:39.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:39.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:39.765+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:40.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:40.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:40.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:40.729+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:41.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:41.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:41.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:41.693+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:42.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:42.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:42.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:42.737+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:42.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:42.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:43.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:43.725+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:44.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:44.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:44.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:44.761+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:45.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:45.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:45.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:45.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:46.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:46.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:46.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:46.829+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:47.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:46.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:47.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:47.825+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:48.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:48.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:48.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:48.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:49.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:49.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:49.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:49.813+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:50.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:50.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:50.830 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:50.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:51.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:51.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:51.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:51.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:52.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:52.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:52.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:52.797+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:53.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:53.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:53.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:53.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:54.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:54.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:54.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:54.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:55.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:55.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:55.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:55.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:56.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:56.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:56.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:56.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:57.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:57.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:57.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:57.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:58.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:58.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:58.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:58.885+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:59.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:33:59.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:33:59.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:33:59.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:00.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:00.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:00.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:00.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:01.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:01.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:01.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:01.861+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:02.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:02.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:02.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:02.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:03.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:03.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:03.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:03.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:04.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:04.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:04.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:04.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:05.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:05.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:05.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:05.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:06.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:06.197+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:06.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:06.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:07.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:07.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:07.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:07.949+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:08.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:08.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:08.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:08.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:09.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:09.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:09.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:09.953+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:10.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:10.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:11.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:11.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:11.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:11.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:11.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:11.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:12.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:12.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:13.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:13.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:13.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:13.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:13.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:13.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:14.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:14.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:15.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:14.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:15.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:15.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:15.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:15.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:16.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:16.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:16.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:16.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:17.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:17.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:17.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:17.972+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:18.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:18.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:18.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:18.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:19.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:19.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:19.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:19.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:20.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:20.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:20.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:20.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:21.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:21.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:21.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:21.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:22.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:22.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:22.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:22.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:23.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:23.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:23.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:23.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:24.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:24.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:24.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:24.860+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:25.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:25.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:25.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:25.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:26.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:26.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:26.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:26.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:27.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:27.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:27.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:27.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:28.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:28.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:29.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:29.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:29.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:29.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:29.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:29.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:30.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:30.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:30.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:30.928+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:31.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:31.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:31.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:31.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:32.280 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:32.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:32.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:32.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:33.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:33.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:33.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:33.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:34.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:34.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:34.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:34.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:35.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:35.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:35.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:35.896+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:36.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:36.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:36.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:36.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:37.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:37.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:37.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:37.928+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:38.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:38.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:38.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:38.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:39.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:39.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:39.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:39.912+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:40.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:40.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:40.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:40.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:41.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:41.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:41.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:41.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:42.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:42.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:42.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:42.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:43.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:43.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:43.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:43.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:44.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:44.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:44.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:44.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:45.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:45.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:45.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:45.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:46.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:46.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:46.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:46.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:47.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:47.356+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:47.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:47.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:48.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:48.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:48.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:48.880+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:49.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:49.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:49.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:49.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:50.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:50.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:50.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:50.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:51.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:51.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:51.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:51.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:52.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:52.480+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:52.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:52.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:53.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:53.476+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:54.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:54.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:54.455 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:54.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:55.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:55.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:55.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:55.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:56.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:56.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:56.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:56.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:57.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:57.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:57.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:57.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:58.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:58.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:58.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:58.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:59.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:34:59.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:34:59.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:34:59.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:00.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:00.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:00.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:00.476+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:01.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:01.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:01.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:01.508+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:02.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:02.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:02.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:02.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:03.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:03.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:03.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:03.540+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:04.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:04.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:04.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:04.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:05.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:05.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:05.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:05.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:06.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:06.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:06.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:06.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:07.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:07.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:07.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:07.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:08.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:08.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:08.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:08.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:09.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:09.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:09.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:09.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:10.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:10.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:10.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:10.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:11.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:11.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:11.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:11.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:12.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:12.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:12.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:12.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:13.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:13.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:13.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:13.579+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:14.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:14.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:14.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:14.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:15.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:15.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:15.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:15.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:16.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:16.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:16.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:16.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:17.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:17.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:17.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:17.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:18.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:18.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:18.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:18.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:19.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:19.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:19.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:19.463+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:20.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:20.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:20.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:20.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:21.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:21.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:21.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:21.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:22.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:22.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:22.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:22.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:23.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:23.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:23.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:23.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:24.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:24.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:24.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:24.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:25.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:25.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:25.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:25.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:26.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:26.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:26.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:26.619+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:27.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:27.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:27.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:27.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:28.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:28.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:28.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:28.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:29.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:29.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:29.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:29.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:30.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:30.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:30.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:30.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:31.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:31.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:31.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:31.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:32.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:32.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:32.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:32.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:33.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:33.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:33.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:33.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:34.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:34.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:34.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:34.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:35.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:35.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:35.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:35.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:36.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:36.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:36.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:36.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:37.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:37.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:37.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:37.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:38.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:38.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:38.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:38.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:39.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:39.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:39.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:39.479+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:40.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:40.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:40.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:40.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:41.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:41.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:41.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:41.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:42.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:42.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:42.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:42.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:43.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:43.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:43.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:43.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:44.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:44.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:44.518 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:44.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:45.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:45.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:45.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:45.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:46.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:46.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:46.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:46.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:47.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:47.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:47.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:47.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:48.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:48.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:48.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:48.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:49.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:49.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:49.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:49.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:50.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:50.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:50.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:50.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:51.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:51.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:51.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:51.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:52.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:52.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:52.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:52.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:53.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:53.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:53.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:53.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:54.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:54.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:54.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:54.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:55.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:55.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:55.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:55.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:56.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:56.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:56.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:56.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:57.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:57.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:57.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:57.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:58.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:58.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:58.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:58.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:59.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:35:59.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:35:59.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:35:59.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:00.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:00.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:00.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:00.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:01.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:01.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:01.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:01.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:02.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:02.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:02.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:02.466+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:03.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:03.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:03.451 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:03.442+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:04.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:04.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:04.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:04.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:05.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:05.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:05.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:05.354+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:06.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:06.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:06.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:06.314+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:07.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:07.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:07.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:07.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:08.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:08.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:08.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:08.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:09.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:09.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:09.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:09.314+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:10.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:10.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:10.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:10.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:11.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:11.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:11.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:11.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:12.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:12.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:12.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:12.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:13.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:13.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:13.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:13.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:14.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:14.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:14.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:14.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:15.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:15.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:15.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:15.386+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:16.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:16.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:16.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:16.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:17.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:17.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:17.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:17.386+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:18.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:18.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:18.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:18.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:19.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:19.330+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:19.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:19.382+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:20.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:20.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:20.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:20.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:21.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:21.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:21.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:21.394+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:22.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:22.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:22.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:22.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:23.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:23.330+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:23.397 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:23.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:24.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:24.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:24.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:24.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:25.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:25.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:25.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:25.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:26.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:26.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:26.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:26.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:27.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:27.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:27.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:27.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:28.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:28.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:28.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:28.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:29.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:29.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:29.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:29.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:30.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:30.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:30.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:30.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:31.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:31.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:31.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:31.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:32.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:32.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:32.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:32.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:33.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:33.330+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:33.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:33.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:34.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:34.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:34.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:34.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:35.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:35.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:35.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:35.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:36.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:36.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:36.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:36.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:37.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:37.350+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:37.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:37.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:38.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:38.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:38.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:38.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:39.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:39.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:39.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:39.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:40.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:40.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:40.523 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:40.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:41.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:41.374+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:41.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:41.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:42.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:42.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:42.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:42.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:43.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:43.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:43.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:43.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:44.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:44.390+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:44.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:44.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:45.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:45.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:45.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:45.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:46.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:46.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:46.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:46.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:47.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:47.373+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:47.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:47.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:48.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:48.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:48.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:48.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:49.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:49.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:49.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:49.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:50.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:50.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:50.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:50.365+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:51.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:51.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:51.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:51.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:52.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:52.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:52.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:52.453+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:53.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:53.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:53.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:53.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:54.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:54.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:54.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:54.489+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:55.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:55.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:55.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:55.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:56.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:56.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:56.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:56.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:57.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:57.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:57.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:57.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:58.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:58.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:58.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:58.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:59.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:36:59.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:36:59.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:36:59.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:00.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:00.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:00.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:00.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:01.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:01.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:01.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:01.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:02.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:02.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:02.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:02.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:03.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:03.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:03.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:03.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:04.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:04.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:04.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:04.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:05.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:05.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:05.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:05.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:06.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:06.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:06.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:06.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:07.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:07.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:07.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:07.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:08.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:08.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:08.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:08.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:09.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:09.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:09.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:09.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:10.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:10.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:10.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:10.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:11.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:11.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:11.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:11.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:12.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:12.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:12.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:12.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:13.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:13.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:13.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:13.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:14.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:14.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:14.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:14.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:15.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:15.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:15.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:15.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:16.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:16.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:16.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:16.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:17.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:17.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:17.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:17.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:18.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:18.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:18.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:18.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:19.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:19.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:19.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:19.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:20.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:20.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:20.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:20.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:21.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:21.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:21.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:21.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:22.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:22.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:22.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:22.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:23.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:23.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:23.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:23.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:24.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:24.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:24.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:24.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:25.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:25.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:25.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:25.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:26.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:26.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:26.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:26.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:27.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:27.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:27.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:27.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:28.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:28.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:28.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:28.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:29.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:29.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:29.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:29.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:30.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:30.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:30.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:30.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:31.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:31.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:31.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:31.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:32.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:32.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:32.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:32.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:33.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:33.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:33.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:33.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:34.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:34.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:34.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:34.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:35.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:35.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:35.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:35.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:36.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:36.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:36.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:36.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:37.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:37.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:37.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:37.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:38.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:38.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:38.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:38.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:39.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:39.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:39.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:39.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:40.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:40.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:40.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:40.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:41.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:41.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:41.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:41.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:42.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:42.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:42.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:42.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:43.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:43.344+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:43.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:43.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:44.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:44.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:44.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:44.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:45.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:45.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:45.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:45.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:46.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:46.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:46.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:46.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:47.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:47.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:47.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:47.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:48.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:48.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:48.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:48.972+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:49.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:49.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:49.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:49.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:50.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:50.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:51.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:51.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:51.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:51.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:51.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:51.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:52.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:52.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:53.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:53.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:53.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:53.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:54.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:54.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:54.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:54.388+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:55.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:55.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:55.397 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:55.392+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:56.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:56.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:56.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:56.424+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:57.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:57.004+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:57.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:57.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:58.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:58.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:58.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:58.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:59.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:37:59.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:37:59.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:37:59.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:00.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:00.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:00.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:00.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:01.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:01.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:01.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:01.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:02.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:02.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:02.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:02.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:03.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:02.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:03.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:03.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:04.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:03.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:04.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:04.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:05.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:05.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:05.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:05.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:06.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:06.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:06.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:06.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:07.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:07.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:07.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:07.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:08.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:08.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:08.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:08.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:09.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:09.092+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:09.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:09.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:10.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:10.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:10.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:10.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:11.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:11.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:11.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:11.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:12.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:12.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:12.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:12.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:13.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:13.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:13.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:13.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:14.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:14.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:14.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:14.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:15.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:15.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:15.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:15.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:16.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:16.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:16.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:16.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:17.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:17.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:17.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:17.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:18.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:18.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:18.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:18.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:19.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:19.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:19.603 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:19.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:20.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:20.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:20.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:20.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:21.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:21.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:21.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:21.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:22.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:22.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:22.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:22.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:23.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:23.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:23.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:23.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:24.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:24.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:24.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:24.672+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:25.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:25.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:25.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:25.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:26.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:26.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:26.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:26.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:27.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:27.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:27.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:27.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:28.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:28.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:28.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:28.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:29.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:29.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:29.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:29.591+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:30.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:30.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:30.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:30.615+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:31.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:30.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:31.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:31.651+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:31.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:31.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:32.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:32.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:32.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:32.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:33.614 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:33.607+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:33.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:33.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:34.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:34.559+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:34.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:34.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:35.538 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:35.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:35.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:35.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:36.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:36.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:36.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:36.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:37.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:37.559+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:37.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:37.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:38.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:38.607+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:38.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:38.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:39.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:39.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:39.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:39.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:40.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:40.587+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:40.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:40.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:41.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:41.543+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:41.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:41.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:42.514 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:42.507+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:42.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:42.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:43.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:43.471+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:43.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:43.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:44.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:44.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:44.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:44.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:45.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:45.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:45.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:45.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:46.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:46.423+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:46.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:46.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:47.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:47.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:47.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:47.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:48.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:48.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:48.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:48.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:49.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:49.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:49.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:49.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:50.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:50.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:50.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:50.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:51.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:51.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:51.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:51.795+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:52.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:52.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:52.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:52.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:53.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:53.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:53.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:53.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:54.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:54.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:54.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:54.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:55.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:55.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:55.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:55.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:56.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:56.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:56.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:56.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:57.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:57.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:57.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:57.827+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:58.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:58.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:58.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:58.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:59.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:38:59.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:38:59.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:38:59.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:00.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:00.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:00.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:00.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:01.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:01.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:01.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:01.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:02.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:02.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:02.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:02.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:03.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:03.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:03.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:03.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:04.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:04.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:04.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:04.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:05.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:05.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:05.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:05.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:06.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:06.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:06.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:06.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:07.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:07.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:07.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:07.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:08.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:08.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:08.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:08.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:09.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:09.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:09.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:09.667+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:10.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:10.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:10.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:10.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:11.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:11.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:11.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:11.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:12.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:12.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:12.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:12.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:13.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:13.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:13.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:13.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:14.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:14.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:14.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:14.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:15.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:15.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:15.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:15.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:16.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:16.407+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:16.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:16.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:17.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:17.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:17.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:17.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:18.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:18.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:18.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:18.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:19.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:19.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:19.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:19.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:20.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:20.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:20.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:20.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:21.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:21.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:21.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:21.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:22.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:22.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:22.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:22.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:23.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:23.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:23.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:23.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:24.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:24.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:24.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:24.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:25.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:25.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:25.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:25.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:26.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:26.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:26.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:26.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:27.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:27.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:27.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:27.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:28.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:28.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:28.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:28.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:29.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:29.478+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:29.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:29.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:30.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:30.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:30.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:30.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:31.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:31.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:31.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:31.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:32.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:32.510+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:32.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:32.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:33.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:33.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:33.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:33.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:34.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:34.522+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:34.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:34.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:35.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:35.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:35.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:35.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:36.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:36.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:36.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:36.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:37.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:37.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:37.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:37.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:38.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:38.522+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:38.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:38.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:39.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:39.518+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:39.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:39.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:40.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:40.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:40.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:40.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:41.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:41.542+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:41.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:41.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:42.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:42.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:42.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:42.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:43.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:43.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:43.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:43.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:44.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:44.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:44.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:44.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:45.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:45.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:45.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:45.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:46.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:46.594+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:46.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:46.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:47.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:47.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:47.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:47.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:48.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:48.558+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:48.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:48.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:49.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:49.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:49.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:49.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:50.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:50.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:50.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:50.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:51.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:51.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:51.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:51.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:52.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:52.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:52.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:52.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:53.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:53.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:53.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:53.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:54.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:54.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:54.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:54.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:55.618 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:55.610+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:55.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:55.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:56.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:56.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:56.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:56.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:57.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:57.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:57.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:57.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:58.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:58.542+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:58.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:58.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:59.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:39:59.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:39:59.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:39:59.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:00.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:00.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:00.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:00.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:01.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:01.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:01.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:01.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:02.659 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:02.650+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:02.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:02.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:03.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:03.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:03.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:03.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:04.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:04.630+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:04.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:04.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:05.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:05.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:05.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:05.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:06.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:06.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:06.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:06.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:07.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:07.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:07.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:07.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:08.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:08.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:08.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:08.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:09.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:09.621+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:09.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:09.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:10.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:10.625+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:10.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:10.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:11.588 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:11.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:11.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:11.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:12.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:12.601+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:12.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:12.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:13.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:13.649+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:13.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:13.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:14.652 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:14.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:14.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:14.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:15.676 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:15.665+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:15.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:15.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:16.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:16.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:16.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:16.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:17.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:17.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:17.867 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:17.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:18.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:18.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:18.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:18.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:19.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:19.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:19.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:19.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:20.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:20.653+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:20.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:20.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:21.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:21.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:21.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:21.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:22.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:22.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:22.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:22.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:23.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:23.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:23.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:23.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:24.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:24.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:24.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:24.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:25.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:25.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:25.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:25.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:26.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:26.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:26.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:26.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:27.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:27.705+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:27.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:27.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:28.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:28.657+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:28.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:28.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:29.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:29.661+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:29.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:29.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:30.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:30.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:30.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:30.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:31.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:31.693+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:31.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:31.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:32.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:32.685+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:32.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:32.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:33.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:33.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:33.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:33.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:34.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:34.629+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:34.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:34.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:35.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:35.637+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:35.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:35.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:36.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:36.637+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:36.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:36.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:37.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:37.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:37.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:37.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:38.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:38.729+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:38.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:38.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:39.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:39.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:39.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:39.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:40.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:40.701+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:40.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:40.745+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:41.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:41.725+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:41.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:41.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:42.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:42.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:42.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:42.777+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:43.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:43.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:43.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:43.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:44.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:44.761+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:44.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:44.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:45.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:45.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:45.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:45.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:46.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:46.705+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:46.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:46.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:47.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:47.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:47.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:47.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:48.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:48.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:48.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:48.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:49.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:49.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:49.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:49.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:50.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:50.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:50.766 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:50.761+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:51.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:51.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:51.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:51.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:52.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:52.733+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:52.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:52.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:53.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:53.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:53.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:53.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:54.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:54.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:54.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:54.749+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:55.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:55.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:55.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:55.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:56.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:56.697+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:56.709 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:56.705+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:57.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:57.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:57.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:57.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:58.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:58.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:58.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:58.753+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:59.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:40:59.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:40:59.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:40:59.753+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:00.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:00.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:00.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:00.804+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:01.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:01.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:01.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:01.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:02.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:02.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:02.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:02.800+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:03.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:03.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:03.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:03.772+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:04.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:04.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:04.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:04.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:05.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:05.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:05.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:05.808+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:06.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:06.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:06.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:06.772+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:07.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:07.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:07.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:07.788+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:08.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:08.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:08.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:08.836+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:09.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:09.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:09.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:09.812+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:10.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:10.788+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:10.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:10.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:11.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:11.804+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:11.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:11.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:12.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:12.824+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:12.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:12.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:13.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:13.784+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:13.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:13.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:14.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:14.796+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:14.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:14.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:15.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:15.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:15.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:15.804+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:16.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:16.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:16.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:16.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:17.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:17.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:17.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:17.836+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:18.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:18.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:18.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:18.816+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:19.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:19.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:19.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:19.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:20.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:20.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:20.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:20.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:21.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:21.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:21.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:21.828+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:22.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:22.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:22.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:22.872+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:23.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:23.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:23.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:23.896+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:24.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:24.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:24.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:24.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:25.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:25.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:25.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:25.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:26.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:26.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:26.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:26.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:27.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:27.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:28.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:28.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:28.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:28.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:29.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:29.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:29.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:29.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:30.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:30.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:30.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:30.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:31.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:31.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:31.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:31.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:32.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:32.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:32.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:32.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:33.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:33.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:33.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:33.972+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:34.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:34.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:34.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:34.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:35.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:35.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:35.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:35.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:36.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:36.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:36.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:36.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:37.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:37.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:37.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:37.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:38.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:38.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:38.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:38.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:39.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:39.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:39.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:39.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:39.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:39.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:40.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:40.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:40.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:40.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:41.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:41.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:42.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:42.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:42.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:42.856+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:43.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:43.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:43.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:43.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:44.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:44.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:44.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:44.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:45.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:45.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:45.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:45.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:46.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:46.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:46.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:46.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:47.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:47.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:47.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:47.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:48.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:48.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:48.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:48.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:49.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:49.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:49.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:49.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:50.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:50.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:50.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:50.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:51.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:51.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:51.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:51.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:52.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:52.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:52.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:52.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:53.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:53.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:53.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:53.795+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:54.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:54.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:54.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:54.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:55.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:55.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:55.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:55.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:56.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:56.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:56.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:56.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:57.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:57.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:57.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:57.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:58.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:58.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:58.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:58.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:59.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:41:59.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:41:59.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:41:59.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:00.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:00.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:00.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:00.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:01.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:01.095+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:01.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:01.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:02.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:02.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:02.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:02.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:03.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:03.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:03.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:03.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:04.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:04.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:04.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:04.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:05.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:05.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:05.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:05.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:06.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:06.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:06.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:06.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:07.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:07.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:07.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:07.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:08.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:08.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:08.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:08.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:09.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:09.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:09.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:09.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:09.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:09.979+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:10.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:10.951+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:11.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:11.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:12.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:11.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:12.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:12.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:12.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:12.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:13.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:13.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:13.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:13.987+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:13.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:13.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:14.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:14.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:15.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:15.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:15.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:15.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:16.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:16.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:17.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:17.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:17.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:17.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:18.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:18.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:18.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:18.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:19.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:19.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:19.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:19.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:20.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:20.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:20.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:20.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:21.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:21.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:21.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:21.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:22.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:21.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:22.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:22.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:23.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:23.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:23.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:23.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:24.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:24.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:24.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:24.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:25.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:25.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:25.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:25.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:26.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:26.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:26.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:26.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:27.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:27.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:27.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:27.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:28.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:28.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:28.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:28.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:29.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:29.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:29.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:29.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:30.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:30.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:30.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:30.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:31.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:31.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:31.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:31.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:32.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:32.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:32.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:32.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:33.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:33.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:33.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:33.115+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:34.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:34.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:34.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:34.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:35.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:35.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:35.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:35.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:36.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:36.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:36.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:36.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:37.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:37.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:37.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:37.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:38.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:38.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:38.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:38.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:39.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:39.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:39.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:39.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:40.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:40.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:40.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:40.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:41.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:41.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:41.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:41.154+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:42.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:42.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:42.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:42.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:43.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:43.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:43.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:43.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:44.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:44.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:44.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:44.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:45.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:45.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:45.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:45.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:46.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:46.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:46.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:46.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:47.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:47.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:47.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:47.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:48.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:48.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:48.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:48.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:49.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:49.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:49.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:49.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:50.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:50.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:50.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:50.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:51.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:51.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:51.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:51.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:52.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:52.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:52.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:52.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:53.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:53.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:53.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:53.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:54.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:54.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:54.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:54.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:55.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:55.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:55.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:55.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:56.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:56.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:56.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:56.086+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:57.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:57.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:57.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:57.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:58.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:58.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:58.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:58.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:59.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:42:59.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:42:59.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:42:59.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:00.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:00.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:00.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:00.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:01.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:01.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:01.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:01.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:02.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:02.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:02.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:02.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:03.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:03.070+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:03.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:03.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:04.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:04.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:04.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:04.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:05.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:05.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:05.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:05.062+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:06.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:06.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:06.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:06.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:07.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:07.050+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:07.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:07.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:08.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:08.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:08.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:08.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:09.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:09.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:09.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:09.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:10.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:10.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:10.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:10.114+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:11.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:11.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:11.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:11.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:12.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:12.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:12.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:12.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:13.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:13.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:13.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:13.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:14.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:14.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:14.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:14.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:15.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:15.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:15.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:15.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:16.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:16.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:16.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:16.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:17.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:17.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:17.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:17.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:18.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:18.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:18.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:18.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:19.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:19.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:19.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:19.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:20.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:20.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:20.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:20.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:21.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:21.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:21.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:21.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:22.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:22.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:22.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:22.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:23.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:23.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:23.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:23.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:24.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:24.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:24.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:24.274+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:25.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:25.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:25.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:25.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:26.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:26.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:26.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:26.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:27.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:27.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:27.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:27.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:28.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:28.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:28.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:28.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:29.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:29.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:29.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:29.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:30.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:30.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:30.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:30.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:31.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:31.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:31.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:31.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:32.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:32.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:32.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:32.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:33.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:33.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:33.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:33.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:34.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:34.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:34.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:34.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:35.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:35.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:35.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:35.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:36.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:36.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:36.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:36.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:37.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:37.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:37.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:37.309+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:38.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:38.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:38.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:38.345+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:39.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:39.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:39.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:39.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:40.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:40.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:40.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:40.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:41.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:41.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:41.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:41.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:42.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:42.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:42.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:42.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:42.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:42.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:43.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:43.313+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:43.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:43.953+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:44.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:44.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:45.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:44.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:45.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:45.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:46.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:45.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:46.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:46.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:47.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:47.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:47.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:47.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:48.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:48.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:48.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:48.273+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:49.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:49.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:49.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:49.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:50.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:50.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:50.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:50.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:51.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:51.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:51.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:51.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:51.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:51.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:52.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:52.313+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:53.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:53.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:53.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:53.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:54.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:54.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:54.350 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:54.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:55.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:55.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:55.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:55.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:56.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:56.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:56.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:56.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:57.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:57.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:57.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:57.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:58.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:58.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:58.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:58.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:59.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:58.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:59.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:43:59.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:43:59.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:43:59.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:00.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:00.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:00.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:00.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:01.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:01.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:01.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:01.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:02.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:02.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:03.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:03.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:03.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:03.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:04.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:04.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:04.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:04.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:05.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:05.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:05.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:05.337+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:06.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:06.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:06.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:06.357+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:07.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:07.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:07.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:07.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:08.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:08.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:08.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:08.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:09.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:09.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:09.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:09.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:10.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:10.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:10.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:10.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:11.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:11.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:11.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:11.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:12.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:12.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:12.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:12.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:13.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:13.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:13.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:13.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:14.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:14.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:14.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:14.289+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:15.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:15.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:15.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:15.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:16.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:16.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:16.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:16.293+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:17.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:17.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:17.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:17.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:18.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:18.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:18.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:18.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:19.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:19.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:19.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:19.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:20.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:20.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:20.379 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:20.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:21.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:21.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:21.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:21.356+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:22.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:22.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:22.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:22.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:23.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:23.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:23.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:23.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:24.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:24.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:24.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:24.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:25.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:25.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:25.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:25.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:26.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:26.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:26.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:26.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:27.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:27.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:27.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:27.368+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:28.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:28.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:28.412 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:28.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:29.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:29.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:29.399 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:29.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:30.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:30.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:30.388 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:30.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:31.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:31.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:31.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:31.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:32.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:32.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:32.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:32.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:33.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:33.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:33.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:33.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:34.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:34.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:34.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:34.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:35.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:35.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:35.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:35.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:36.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:36.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:36.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:36.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:37.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:37.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:37.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:37.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:38.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:38.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:38.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:38.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:39.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:39.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:39.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:39.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:40.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:40.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:40.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:40.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:41.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:41.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:41.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:41.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:42.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:42.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:42.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:42.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:43.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:43.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:43.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:43.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:44.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:44.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:44.431 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:44.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:45.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:45.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:45.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:45.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:46.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:46.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:46.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:46.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:47.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:47.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:47.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:47.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:48.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:48.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:48.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:48.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:49.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:49.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:49.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:49.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:50.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:50.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:50.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:50.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:51.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:51.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:51.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:51.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:52.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:52.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:52.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:52.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:53.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:53.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:53.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:53.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:54.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:54.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:54.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:54.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:55.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:55.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:55.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:55.428+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:56.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:56.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:56.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:56.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:57.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:57.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:57.412 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:57.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:58.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:58.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:58.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:58.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:59.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:44:59.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:44:59.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:44:59.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:00.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:00.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:00.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:00.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:01.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:01.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:01.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:01.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:02.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:02.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:02.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:02.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:03.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:03.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:03.395 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:03.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:04.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:04.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:04.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:04.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:05.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:05.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:05.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:05.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:06.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:06.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:06.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:06.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:07.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:07.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:07.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:07.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:08.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:08.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:08.491 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:08.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:09.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:09.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:09.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:09.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:10.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:10.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:10.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:10.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:11.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:11.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:11.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:11.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:12.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:12.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:12.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:12.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:13.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:13.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:13.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:13.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:14.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:14.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:14.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:14.431+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:15.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:15.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:15.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:15.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:16.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:16.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:16.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:16.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:17.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:17.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:17.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:17.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:18.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:18.175+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:18.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:18.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:19.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:19.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:19.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:19.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:20.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:20.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:20.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:20.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:21.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:21.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:21.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:21.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:22.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:22.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:22.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:22.559+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:23.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:23.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:23.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:23.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:24.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:24.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:24.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:24.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:25.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:25.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:25.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:25.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:26.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:26.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:26.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:26.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:27.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:27.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:27.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:27.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:28.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:28.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:28.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:28.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:29.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:29.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:29.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:29.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:30.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:30.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:30.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:30.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:31.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:31.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:31.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:31.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:32.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:32.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:32.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:32.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:33.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:33.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:33.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:33.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:34.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:34.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:34.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:34.655+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:35.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:35.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:35.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:35.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:36.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:36.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:36.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:36.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:37.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:37.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:37.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:37.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:38.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:38.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:38.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:38.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:39.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:39.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:39.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:39.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:40.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:40.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:40.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:40.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:41.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:41.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:41.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:41.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:42.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:42.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:42.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:42.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:43.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:43.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:43.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:43.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:44.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:44.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:44.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:44.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:45.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:45.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:45.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:45.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:46.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:46.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:46.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:46.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:47.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:47.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:47.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:47.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:48.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:48.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:48.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:48.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:49.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:49.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:49.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:49.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:50.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:50.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:50.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:50.735+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:51.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:51.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:51.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:51.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:52.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:52.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:52.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:52.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:53.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:53.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:53.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:53.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:54.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:54.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:54.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:54.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:55.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:55.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:55.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:55.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:56.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:56.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:56.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:56.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:57.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:57.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:57.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:57.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:58.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:58.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:58.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:58.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:59.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:45:59.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:45:59.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:45:59.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:00.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:00.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:00.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:00.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:01.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:01.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:01.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:01.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:02.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:02.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:02.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:02.786+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:03.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:02.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:03.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:03.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:04.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:04.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:04.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:04.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:05.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:05.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:05.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:05.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:06.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:06.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:06.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:06.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:07.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:07.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:07.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:07.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:08.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:08.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:08.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:08.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:09.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:09.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:09.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:09.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:10.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:10.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:10.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:10.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:11.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:11.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:11.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:11.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:12.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:12.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:12.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:12.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:13.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:13.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:13.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:13.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:13.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:13.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:14.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:14.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:14.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:14.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:15.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:15.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:15.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:15.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:16.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:16.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:16.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:16.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:17.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:17.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:17.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:17.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:18.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:18.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:18.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:18.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:19.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:19.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:19.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:19.870+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:20.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:20.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:20.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:20.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:21.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:21.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:21.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:21.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:22.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:22.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:22.869 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:22.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:23.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:23.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:23.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:23.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:24.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:24.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:24.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:24.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:25.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:25.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:25.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:25.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:26.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:26.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:26.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:26.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:27.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:27.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:27.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:27.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:28.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:28.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:28.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:28.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:29.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:29.726+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:29.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:29.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:30.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:30.690+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:30.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:30.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:31.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:31.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:31.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:31.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:32.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:32.682+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:32.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:32.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:33.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:33.702+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:33.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:33.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:34.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:34.718+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:34.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:34.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:35.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:35.702+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:35.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:35.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:36.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:36.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:36.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:36.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:37.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:37.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:37.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:37.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:38.705 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:38.694+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:38.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:38.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:39.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:39.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:39.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:39.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:40.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:40.650+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:40.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:40.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:41.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:41.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:41.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:41.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:42.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:42.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:42.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:42.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:43.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:43.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:43.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:43.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:44.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:44.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:44.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:44.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:45.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:45.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:45.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:45.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:46.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:46.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:46.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:46.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:47.652 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:47.642+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:47.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:47.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:48.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:48.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:48.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:48.682+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:49.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:49.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:49.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:49.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:50.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:50.673+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:50.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:50.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:51.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:51.673+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:51.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:51.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:52.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:52.721+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:52.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:52.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:53.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:53.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:53.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:53.749+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:54.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:54.697+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:54.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:54.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:55.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:55.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:55.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:55.741+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:56.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:56.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:56.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:56.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:57.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:57.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:57.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:57.805+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:58.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:58.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:58.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:58.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:59.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:46:59.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:46:59.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:46:59.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:00.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:00.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:00.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:00.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:01.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:01.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:01.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:01.797+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:02.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:02.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:02.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:02.825+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:03.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:03.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:03.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:03.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:04.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:04.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:04.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:04.845+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:05.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:05.653+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:05.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:05.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:06.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:06.645+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:06.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:06.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:07.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:07.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:07.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:07.893+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:08.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:08.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:08.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:08.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:09.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:09.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:09.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:09.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:10.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:10.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:10.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:10.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:11.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:11.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:11.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:11.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:12.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:12.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:13.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:13.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:13.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:13.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:14.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:14.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:14.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:14.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:15.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:15.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:15.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:15.645+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:16.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:16.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:16.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:16.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:17.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:17.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:17.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:17.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:18.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:18.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:18.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:18.653+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:19.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:19.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:19.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:19.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:20.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:20.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:20.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:20.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:21.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:21.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:21.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:21.705+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:22.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:22.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:22.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:22.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:23.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:23.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:23.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:23.721+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:24.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:24.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:24.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:24.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:25.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:25.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:25.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:25.709+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:26.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:26.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:26.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:26.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:27.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:27.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:27.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:27.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:28.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:28.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:28.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:28.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:29.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:29.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:29.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:29.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:30.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:30.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:30.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:30.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:31.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:31.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:31.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:31.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:32.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:32.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:32.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:32.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:33.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:33.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:33.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:33.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:34.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:34.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:34.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:34.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:35.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:35.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:35.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:35.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:36.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:36.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:36.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:36.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:37.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:37.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:37.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:37.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:38.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:38.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:38.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:38.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:39.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:39.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:39.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:39.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:40.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:40.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:40.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:40.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:41.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:41.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:41.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:41.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:42.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:42.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:42.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:42.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:43.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:43.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:43.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:43.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:44.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:44.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:44.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:44.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:45.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:45.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:45.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:45.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:46.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:46.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:46.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:46.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:47.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:47.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:47.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:47.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:48.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:48.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:48.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:48.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:49.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:49.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:49.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:49.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:50.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:50.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:50.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:50.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:51.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:51.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:51.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:51.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:51.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:51.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:52.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:52.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:53.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:52.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:53.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:53.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:53.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:53.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:54.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:54.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:54.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:54.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:55.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:55.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:55.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:55.972+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:56.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:56.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:57.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:57.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:57.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:57.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:57.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:57.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:58.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:58.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:59.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:47:59.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:47:59.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:47:59.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:00.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:00.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:00.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:00.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:00.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:00.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:01.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:01.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:01.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:01.972+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:02.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:02.656+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:03.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:03.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:03.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:03.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:04.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:04.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:04.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:04.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:05.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:05.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:05.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:05.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:06.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:06.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:06.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:06.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:07.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:07.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:07.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:07.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:08.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:08.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:08.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:08.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:09.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:09.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:09.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:09.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:10.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:10.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:10.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:10.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:10.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:10.972+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:11.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:11.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:11.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:11.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:12.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:12.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:12.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:12.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:13.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:13.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:14.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:13.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:14.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:14.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:15.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:15.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:15.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:15.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:16.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:16.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:16.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:16.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:17.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:17.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:17.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:17.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:18.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:18.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:18.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:18.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:18.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:18.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:19.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:19.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:20.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:20.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:20.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:20.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:20.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:20.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:21.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:21.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:21.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:21.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:22.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:22.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:22.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:22.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:23.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:23.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:23.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:23.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:24.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:24.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:24.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:24.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:25.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:25.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:25.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:25.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:26.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:26.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:26.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:26.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:27.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:27.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:27.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:27.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:28.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:28.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:29.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:28.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:29.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:29.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:29.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:29.967+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:30.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:30.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:30.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:30.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:31.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:31.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:31.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:31.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:32.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:32.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:32.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:32.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:33.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:33.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:33.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:33.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:34.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:34.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:34.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:34.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:35.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:35.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:35.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:35.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:36.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:36.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:36.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:36.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:37.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:37.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:37.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:37.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:38.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:38.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:38.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:38.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:39.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:39.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:39.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:39.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:40.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:40.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:40.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:40.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:41.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:41.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:41.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:41.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:42.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:42.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:42.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:42.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:43.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:43.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:43.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:43.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:44.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:44.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:44.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:44.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:45.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:45.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:45.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:45.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:46.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:46.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:46.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:46.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:47.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:47.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:48.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:48.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:48.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:48.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:49.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:49.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:50.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:49.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:50.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:50.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:51.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:51.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:51.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:51.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:52.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:52.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:52.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:52.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:52.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:52.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:53.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:53.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:54.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:53.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:54.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:54.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:55.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:55.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:55.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:55.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:56.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:56.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:56.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:56.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:57.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:57.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:57.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:57.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:58.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:58.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:58.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:58.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:59.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:48:59.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:48:59.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:48:59.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:00.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:00.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:00.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:00.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:01.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:01.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:01.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:01.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:02.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:02.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:02.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:02.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:03.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:03.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:03.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:03.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:04.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:04.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:04.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:04.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:05.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:05.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:05.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:05.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:06.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:06.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:06.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:06.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:07.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:07.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:07.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:07.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:08.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:08.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:08.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:08.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:09.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:09.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:09.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:09.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:10.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:10.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:10.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:10.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:11.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:11.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:11.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:11.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:12.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:12.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:12.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:12.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:13.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:13.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:13.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:13.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:14.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:14.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:14.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:14.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:15.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:15.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:15.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:15.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:16.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:16.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:16.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:16.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:17.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:17.247+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:17.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:17.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:18.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:18.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:18.300 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:18.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:19.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:19.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:19.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:19.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:20.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:20.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:20.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:20.362+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:21.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:21.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:21.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:21.330+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:22.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:22.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:22.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:22.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:23.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:23.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:23.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:23.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:24.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:24.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:24.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:24.374+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:25.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:25.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:25.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:25.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:26.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:26.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:26.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:26.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:27.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:27.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:27.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:27.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:28.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:28.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:28.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:28.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:29.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:29.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:29.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:29.354+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:30.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:30.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:30.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:30.354+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:31.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:31.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:31.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:31.370+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:32.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:32.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:32.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:32.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:33.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:33.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:33.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:33.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:34.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:34.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:34.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:34.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:35.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:35.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:35.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:35.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:36.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:36.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:36.336 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:36.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:37.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:37.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:37.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:37.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:38.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:38.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:38.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:38.342+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:39.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:39.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:39.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:39.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:40.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:40.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:40.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:40.286+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:41.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:41.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:41.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:41.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:42.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:42.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:42.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:42.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:43.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:43.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:43.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:43.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:44.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:44.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:44.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:44.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:45.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:45.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:45.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:45.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:46.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:46.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:46.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:46.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:47.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:47.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:47.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:47.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:48.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:48.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:48.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:48.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:49.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:49.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:49.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:49.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:50.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:50.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:50.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:50.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:51.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:51.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:51.280 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:51.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:52.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:52.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:52.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:52.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:53.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:53.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:53.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:53.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:54.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:54.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:54.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:54.286+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:55.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:55.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:55.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:55.274+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:56.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:56.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:56.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:56.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:57.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:57.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:57.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:57.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:58.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:58.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:58.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:58.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:59.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:49:59.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:49:59.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:49:59.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:00.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:00.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:00.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:00.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:01.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:01.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:01.280 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:01.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:02.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:02.090+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:02.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:02.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:03.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:03.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:03.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:03.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:04.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:04.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:04.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:04.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:05.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:05.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:05.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:05.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:06.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:06.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:06.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:06.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:07.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:07.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:07.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:07.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:08.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:08.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:08.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:08.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:09.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:09.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:09.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:09.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:10.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:10.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:10.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:10.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:11.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:11.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:11.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:11.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:12.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:12.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:12.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:12.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:13.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:13.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:13.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:13.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:14.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:14.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:14.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:14.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:15.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:15.045+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:15.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:15.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:16.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:16.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:16.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:16.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:17.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:17.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:17.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:17.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:18.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:18.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:18.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:18.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:19.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:19.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:19.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:19.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:20.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:20.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:20.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:20.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:21.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:21.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:21.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:21.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:22.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:22.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:22.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:22.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:23.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:23.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:23.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:23.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:24.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:24.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:24.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:24.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:25.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:25.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:25.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:25.133+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:26.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:26.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:26.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:26.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:27.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:27.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:27.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:27.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:28.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:28.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:28.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:28.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:29.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:29.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:29.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:29.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:30.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:30.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:30.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:30.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:31.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:31.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:31.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:31.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:32.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:32.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:32.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:32.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:33.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:33.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:33.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:33.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:34.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:34.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:34.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:34.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:35.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:35.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:35.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:35.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:36.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:36.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:36.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:36.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:37.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:37.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:37.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:37.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:38.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:38.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:38.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:38.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:39.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:39.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:39.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:39.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:40.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:40.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:40.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:40.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:41.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:41.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:41.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:41.285+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:42.270 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:42.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:42.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:42.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:43.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:43.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:43.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:43.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:44.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:44.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:44.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:44.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:45.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:45.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:45.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:45.321+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:46.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:46.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:46.360 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:46.353+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:47.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:47.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:47.387 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:47.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:48.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:48.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:48.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:48.409+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:49.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:49.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:49.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:49.441+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:50.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:50.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:50.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:50.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:51.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:51.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:51.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:51.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:52.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:52.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:52.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:52.453+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:53.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:53.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:53.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:53.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:54.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:54.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:54.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:54.445+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:55.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:55.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:55.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:55.485+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:56.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:56.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:56.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:56.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:57.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:57.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:57.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:57.556+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:58.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:58.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:58.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:58.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:59.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:50:59.504+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:50:59.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:50:59.640+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:00.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:00.552+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:00.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:00.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:01.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:01.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:01.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:01.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:02.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:02.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:02.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:02.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:03.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:03.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:03.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:03.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:04.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:04.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:04.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:04.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:05.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:05.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:05.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:05.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:06.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:06.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:06.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:06.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:07.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:07.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:07.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:07.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:08.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:08.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:08.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:08.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:09.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:09.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:09.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:09.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:10.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:10.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:10.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:10.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:11.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:11.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:11.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:11.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:12.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:12.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:12.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:12.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:13.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:13.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:13.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:13.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:14.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:14.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:14.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:14.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:15.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:15.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:15.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:15.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:16.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:16.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:16.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:16.648+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:17.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:17.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:17.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:17.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:18.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:18.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:18.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:18.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:19.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:19.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:19.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:19.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:20.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:20.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:20.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:20.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:21.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:21.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:21.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:21.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:22.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:22.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:22.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:22.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:23.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:23.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:23.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:23.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:24.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:24.576+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:24.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:24.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:25.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:25.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:25.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:25.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:26.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:26.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:26.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:26.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:27.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:27.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:27.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:27.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:28.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:28.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:28.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:28.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:29.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:29.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:29.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:29.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:30.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:30.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:30.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:30.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:31.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:31.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:31.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:31.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:32.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:32.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:32.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:32.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:33.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:33.736+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:33.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:33.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:34.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:34.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:34.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:34.780+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:35.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:35.756+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:35.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:35.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:36.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:36.804+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:36.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:36.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:37.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:37.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:37.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:37.844+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:38.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:38.816+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:38.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:38.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:39.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:39.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:39.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:39.860+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:40.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:40.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:40.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:40.872+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:41.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:41.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:41.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:41.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:42.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:42.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:42.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:42.864+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:43.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:43.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:43.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:43.844+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:44.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:44.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:44.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:44.832+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:45.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:45.796+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:45.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:45.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:46.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:46.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:46.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:46.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:47.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:47.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:47.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:47.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:48.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:48.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:48.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:48.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:49.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:49.827+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:49.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:49.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:50.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:50.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:50.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:50.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:51.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:51.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:51.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:51.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:52.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:52.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:52.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:52.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:53.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:53.827+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:53.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:53.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:54.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:54.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:54.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:54.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:55.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:55.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:55.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:55.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:56.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:56.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:56.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:56.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:57.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:57.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:57.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:57.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:58.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:58.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:58.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:58.815+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:59.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:51:59.751+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:51:59.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:51:59.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:00.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:00.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:00.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:00.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:01.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:01.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:01.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:01.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:02.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:02.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:02.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:02.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:03.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:03.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:03.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:03.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:04.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:04.699+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:04.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:04.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:05.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:05.679+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:05.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:05.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:06.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:06.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:06.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:06.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:07.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:07.687+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:07.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:07.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:08.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:08.699+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:08.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:08.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:09.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:09.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:09.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:09.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:10.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:10.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:10.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:10.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:11.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:11.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:11.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:11.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:12.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:12.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:12.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:12.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:13.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:13.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:13.804 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:13.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:14.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:14.655+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:14.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:14.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:15.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:15.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:15.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:15.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:16.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:16.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:16.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:16.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:17.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:17.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:17.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:17.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:18.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:18.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:18.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:18.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:19.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:19.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:19.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:19.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:20.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:20.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:20.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:20.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:21.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:21.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:21.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:21.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:22.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:22.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:22.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:22.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:23.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:23.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:23.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:23.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:24.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:24.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:24.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:24.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:25.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:25.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:25.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:25.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:26.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:26.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:26.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:26.847+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:27.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:27.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:27.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:27.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:28.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:28.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:28.878 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:28.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:29.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:29.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:29.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:29.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:30.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:30.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:30.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:30.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:31.409 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:31.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:31.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:31.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:32.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:32.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:32.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:32.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:33.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:33.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:33.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:33.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:34.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:34.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:34.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:34.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:35.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:35.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:35.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:35.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:36.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:36.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:36.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:36.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:37.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:37.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:37.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:37.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:38.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:38.450+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:39.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:38.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:39.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:39.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:40.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:40.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:40.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:40.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:41.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:41.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:41.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:41.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:42.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:42.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:42.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:42.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:42.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:42.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:43.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:43.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:43.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:43.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:44.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:44.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:45.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:44.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:45.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:45.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:46.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:45.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:46.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:46.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:47.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:47.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:47.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:47.450+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:48.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:48.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:48.426 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:48.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:49.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:49.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:49.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:49.410+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:50.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:50.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:50.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:50.398+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:51.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:51.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:51.379 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:51.370+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:52.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:52.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:52.387 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:52.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:53.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:53.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:53.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:53.410+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:53.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:53.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:54.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:54.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:54.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:54.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:55.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:55.422+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:55.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:55.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:56.387 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:56.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:56.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:56.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:57.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:57.406+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:57.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:57.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:58.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:58.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:58.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:58.894+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:59.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:52:59.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:52:59.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:52:59.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:00.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:00.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:00.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:00.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:01.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:01.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:01.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:01.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:02.451 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:02.442+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:02.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:02.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:03.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:03.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:03.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:03.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:04.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:04.450+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:04.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:04.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:05.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:05.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:06.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:06.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:06.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:06.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:07.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:07.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:07.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:07.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:08.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:08.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:08.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:08.526+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:09.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:09.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:09.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:09.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:10.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:10.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:10.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:10.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:11.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:11.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:11.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:11.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:12.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:12.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:12.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:12.514+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:13.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:13.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:13.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:13.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:14.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:14.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:14.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:14.458+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:15.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:15.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:15.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:15.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:16.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:16.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:16.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:16.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:17.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:17.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:17.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:17.446+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:18.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:18.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:18.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:18.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:19.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:19.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:19.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:19.494+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:20.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:20.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:20.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:20.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:21.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:21.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:21.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:21.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:22.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:22.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:22.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:22.526+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:23.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:23.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:23.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:23.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:24.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:24.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:24.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:24.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:25.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:25.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:25.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:25.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:26.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:26.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:26.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:26.477+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:27.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:27.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:27.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:27.457+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:28.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:28.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:28.474 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:28.465+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:29.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:29.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:29.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:29.433+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:30.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:30.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:30.451 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:30.441+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:31.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:31.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:31.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:31.437+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:32.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:32.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:32.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:32.405+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:33.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:33.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:33.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:33.425+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:34.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:34.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:34.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:34.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:35.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:35.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:35.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:35.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:36.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:36.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:36.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:36.425+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:37.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:37.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:37.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:37.397+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:38.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:38.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:38.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:38.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:39.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:39.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:39.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:39.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:40.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:40.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:40.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:40.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:41.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:41.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:41.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:41.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:42.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:42.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:42.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:42.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:43.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:43.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:43.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:43.441+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:44.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:44.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:44.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:44.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:45.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:45.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:45.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:45.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:46.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:46.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:46.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:46.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:47.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:47.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:47.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:47.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:48.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:48.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:48.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:48.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:49.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:49.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:49.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:49.365+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:50.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:50.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:50.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:50.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:51.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:51.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:51.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:51.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:52.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:52.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:52.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:52.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:53.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:53.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:53.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:53.405+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:54.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:54.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:54.412 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:54.401+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:55.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:55.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:55.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:55.421+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:56.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:56.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:56.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:56.409+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:57.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:57.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:57.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:57.409+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:58.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:58.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:58.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:58.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:59.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:53:59.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:53:59.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:53:59.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:00.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:00.285+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:00.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:00.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:01.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:01.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:01.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:01.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:02.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:02.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:02.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:02.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:03.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:03.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:03.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:03.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:04.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:04.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:04.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:04.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:05.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:05.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:05.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:05.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:06.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:06.197+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:06.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:06.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:07.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:07.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:07.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:07.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:08.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:08.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:08.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:08.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:09.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:09.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:09.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:09.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:10.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:10.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:10.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:10.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:11.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:11.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:11.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:11.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:12.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:12.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:12.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:12.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:13.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:13.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:13.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:13.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:14.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:14.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:14.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:14.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:15.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:15.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:15.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:15.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:16.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:16.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:16.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:16.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:17.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:17.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:17.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:17.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:18.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:18.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:18.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:18.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:19.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:19.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:19.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:19.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:20.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:20.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:20.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:20.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:21.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:21.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:21.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:21.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:22.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:22.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:22.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:22.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:23.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:23.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:23.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:23.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:24.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:24.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:24.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:24.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:25.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:25.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:25.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:25.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:26.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:26.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:26.596 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:26.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:27.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:27.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:27.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:27.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:28.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:28.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:28.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:28.552+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:29.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:29.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:29.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:29.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:30.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:30.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:30.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:30.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:31.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:31.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:31.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:31.516+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:32.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:32.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:32.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:32.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:33.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:33.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:33.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:33.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:34.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:34.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:34.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:34.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:35.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:35.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:35.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:35.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:36.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:36.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:36.411 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:36.400+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:37.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:37.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:37.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:37.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:38.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:38.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:38.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:38.324+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:39.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:39.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:39.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:39.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:40.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:40.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:40.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:40.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:41.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:41.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:41.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:41.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:42.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:42.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:42.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:42.324+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:43.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:43.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:43.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:43.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:44.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:44.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:44.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:44.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:45.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:45.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:45.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:45.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:46.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:46.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:46.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:46.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:47.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:47.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:47.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:47.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:48.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:48.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:48.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:48.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:49.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:49.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:49.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:49.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:50.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:50.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:50.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:50.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:51.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:51.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:51.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:51.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:52.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:52.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:52.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:52.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:53.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:53.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:53.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:53.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:54.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:54.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:54.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:54.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:55.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:55.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:55.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:55.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:56.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:56.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:56.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:56.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:57.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:57.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:57.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:57.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:58.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:58.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:58.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:58.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:59.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:54:59.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:54:59.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:54:59.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:00.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:00.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:00.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:00.324+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:01.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:01.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:01.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:01.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:02.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:02.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:02.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:02.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:03.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:03.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:03.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:03.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:04.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:04.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:04.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:04.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:05.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:05.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:05.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:05.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:06.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:06.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:06.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:06.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:07.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:07.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:07.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:07.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:08.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:08.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:08.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:08.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:09.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:09.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:09.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:09.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:10.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:10.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:10.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:10.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:11.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:11.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:11.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:11.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:12.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:12.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:12.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:12.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:13.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:13.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:13.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:13.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:14.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:14.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:14.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:14.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:15.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:15.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:15.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:15.407+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:16.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:16.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:16.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:16.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:17.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:17.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:17.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:17.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:18.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:18.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:18.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:18.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:19.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:19.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:19.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:19.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:20.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:20.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:20.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:20.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:21.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:21.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:21.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:21.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:22.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:22.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:22.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:22.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:23.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:23.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:23.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:23.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:24.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:24.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:24.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:24.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:25.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:25.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:25.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:25.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:26.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:26.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:26.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:26.471+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:27.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:27.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:27.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:27.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:28.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:28.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:28.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:28.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:29.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:29.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:29.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:29.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:30.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:30.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:30.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:30.547+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:31.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:31.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:31.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:31.583+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:32.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:32.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:32.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:32.603+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:33.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:33.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:33.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:33.599+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:34.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:34.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:34.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:34.611+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:35.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:35.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:35.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:35.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:36.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:36.195+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:36.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:36.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:37.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:37.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:37.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:37.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:38.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:38.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:38.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:38.655+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:39.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:39.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:39.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:39.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:40.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:40.203+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:40.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:40.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:41.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:41.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:41.652 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:41.643+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:42.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:42.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:42.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:42.619+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:43.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:43.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:43.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:43.599+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:44.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:44.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:44.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:44.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:45.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:45.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:45.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:45.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:46.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:46.255+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:46.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:46.635+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:47.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:47.227+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:47.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:47.631+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:48.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:48.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:48.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:48.635+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:49.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:49.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:49.665 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:49.655+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:50.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:50.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:50.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:50.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:51.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:51.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:51.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:51.718+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:52.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:52.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:52.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:52.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:53.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:53.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:53.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:53.714+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:54.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:54.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:54.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:54.710+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:55.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:55.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:55.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:55.678+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:56.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:56.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:56.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:56.698+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:57.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:57.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:57.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:57.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:58.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:58.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:58.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:58.694+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:59.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:55:59.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:55:59.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:55:59.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:00.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:00.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:00.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:00.658+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:01.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:01.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:01.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:01.678+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:02.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:02.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:02.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:02.706+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:03.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:03.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:03.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:03.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:04.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:04.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:04.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:04.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:05.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:05.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:05.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:05.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:06.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:06.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:06.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:06.630+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:07.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:07.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:07.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:07.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:08.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:08.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:08.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:08.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:09.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:09.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:09.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:09.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:10.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:10.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:10.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:10.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:11.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:11.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:11.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:11.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:12.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:12.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:12.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:12.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:13.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:13.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:13.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:13.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:14.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:14.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:14.637 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:14.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:15.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:15.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:15.674 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:15.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:16.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:16.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:16.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:16.698+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:17.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:17.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:17.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:17.710+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:18.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:18.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:18.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:18.710+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:19.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:19.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:19.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:19.714+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:20.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:20.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:20.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:20.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:21.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:21.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:21.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:21.726+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:22.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:22.154+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:22.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:22.718+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:23.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:23.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:23.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:23.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:24.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:24.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:24.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:24.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:25.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:25.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:25.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:25.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:26.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:26.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:26.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:26.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:27.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:27.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:27.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:27.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:28.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:28.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:28.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:28.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:29.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:29.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:29.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:29.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:30.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:30.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:30.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:30.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:31.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:31.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:31.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:31.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:32.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:32.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:32.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:32.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:33.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:33.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:33.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:33.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:34.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:34.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:35.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:35.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:35.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:35.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:35.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:35.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:36.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:36.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:36.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:36.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:37.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:37.286+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:37.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:37.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:38.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:38.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:38.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:38.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:39.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:39.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:39.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:39.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:40.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:40.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:40.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:40.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:41.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:41.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:41.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:41.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:42.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:42.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:42.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:42.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:43.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:43.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:43.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:43.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:44.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:44.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:45.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:45.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:45.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:45.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:46.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:46.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:46.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:46.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:47.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:47.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:47.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:47.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:47.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:47.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:48.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:48.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:49.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:49.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:49.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:49.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:50.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:50.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:50.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:50.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:51.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:51.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:51.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:51.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:52.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:52.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:52.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:52.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:53.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:53.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:53.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:53.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:54.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:54.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:54.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:54.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:55.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:55.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:55.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:55.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:56.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:55.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:56.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:56.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:56.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:56.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:57.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:57.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:58.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:57.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:58.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:58.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:58.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:58.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:59.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:59.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:59.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:56:59.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:56:59.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:56:59.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:00.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:00.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:01.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:00.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:01.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:01.897+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:02.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:02.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:02.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:02.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:03.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:03.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:03.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:03.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:04.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:04.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:04.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:04.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:05.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:05.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:05.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:05.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:06.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:06.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:06.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:06.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:07.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:07.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:07.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:07.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:08.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:08.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:08.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:08.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:09.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:09.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:09.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:09.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:10.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:10.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:10.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:10.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:11.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:11.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:11.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:11.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:12.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:12.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:12.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:12.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:13.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:12.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:13.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:13.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:14.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:14.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:14.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:14.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:15.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:15.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:15.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:15.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:16.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:16.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:16.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:16.953+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:17.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:17.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:17.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:17.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:18.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:18.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:18.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:18.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:19.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:19.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:19.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:19.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:20.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:20.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:20.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:20.829+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:21.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:21.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:21.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:21.829+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:22.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:22.205+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:22.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:22.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:23.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:23.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:23.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:23.897+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:24.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:24.301+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:24.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:24.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:25.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:25.293+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:25.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:25.853+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:26.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:26.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:26.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:26.849+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:27.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:27.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:27.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:27.861+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:28.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:28.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:28.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:28.877+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:29.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:29.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:29.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:29.917+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:30.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:30.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:30.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:30.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:31.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:31.289+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:32.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:32.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:32.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:32.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:33.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:33.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:33.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:33.289+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:34.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:34.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:34.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:34.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:34.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:34.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:35.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:35.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:36.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:36.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:36.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:36.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:36.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:36.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:37.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:37.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:38.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:38.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:38.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:38.321+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:39.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:39.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:39.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:39.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:40.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:40.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:40.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:40.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:41.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:41.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:41.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:41.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:42.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:42.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:42.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:42.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:43.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:43.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:43.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:43.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:44.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:44.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:44.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:44.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:45.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:45.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:45.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:45.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:46.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:46.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:46.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:46.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:47.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:47.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:47.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:47.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:48.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:48.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:48.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:48.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:49.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:49.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:49.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:49.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:50.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:50.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:50.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:50.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:51.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:51.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:51.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:51.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:52.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:52.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:52.320 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:52.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:52.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:52.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:53.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:53.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:54.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:54.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:54.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:54.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:55.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:55.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:55.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:55.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:56.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:56.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:56.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:56.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:57.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:57.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:57.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:57.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:58.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:58.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:58.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:58.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:59.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:57:59.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:57:59.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:57:59.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:00.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:00.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:00.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:00.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:01.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:01.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:01.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:01.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:02.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:02.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:02.379 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:02.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:02.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:02.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:03.430 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:03.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:04.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:04.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:04.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:04.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:04.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:04.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:05.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:05.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:06.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:06.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:06.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:06.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:06.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:06.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:07.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:07.480+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:07.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:07.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:08.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:08.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:08.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:08.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:09.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:09.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:09.900 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:09.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:10.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:10.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:10.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:10.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:11.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:11.460+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:11.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:11.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:12.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:12.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:12.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:12.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:13.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:13.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:14.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:13.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:14.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:14.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:15.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:14.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:15.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:15.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:15.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:15.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:16.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:16.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:16.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:16.928+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:17.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:17.576+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:17.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:17.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:18.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:18.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:18.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:18.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:19.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:19.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:19.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:19.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:20.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:20.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:20.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:20.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:21.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:21.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:21.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:21.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:22.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:22.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:23.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:22.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:23.527 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:23.520+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:23.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:23.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:24.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:24.528+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:25.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:25.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:25.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:25.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:26.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:26.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:26.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:26.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:27.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:27.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:27.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:27.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:27.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:27.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:28.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:28.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:28.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:28.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:29.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:29.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:30.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:30.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:30.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:30.428+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:30.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:30.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:31.413 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:31.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:32.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:32.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:32.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:32.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:33.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:33.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:33.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:33.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:34.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:34.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:34.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:34.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:34.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:34.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:35.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:35.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:36.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:36.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:36.430 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:36.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:37.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:37.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:37.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:37.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:38.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:38.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:38.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:38.435+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:39.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:38.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:39.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:39.439+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:39.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:39.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:40.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:40.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:40.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:40.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:41.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:41.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:41.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:41.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:42.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:42.463+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:42.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:42.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:43.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:43.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:43.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:43.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:44.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:44.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:45.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:45.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:45.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:45.435+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:46.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:46.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:46.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:46.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:47.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:47.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:47.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:47.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:48.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:48.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:48.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:48.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:49.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:49.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:49.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:49.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:50.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:49.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:50.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:50.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:51.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:51.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:51.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:51.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:52.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:51.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:52.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:52.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:53.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:53.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:53.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:53.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:54.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:54.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:54.486 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:54.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:55.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:55.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:55.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:55.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:56.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:56.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:56.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:56.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:57.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:57.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:57.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:57.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:58.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:58.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:58.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:58.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:59.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:58:58.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:58:59.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:58:59.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:00.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:00.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:00.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:00.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:01.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:01.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:01.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:01.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:02.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:02.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:02.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:02.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:03.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:03.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:03.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:03.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:04.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:04.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:04.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:04.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:05.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:05.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:05.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:05.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:06.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:06.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:06.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:06.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:07.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:07.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:07.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:07.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:08.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:08.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:08.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:08.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:09.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:09.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:09.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:09.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:10.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:10.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:10.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:10.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:11.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:11.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:11.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:11.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:12.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:12.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:12.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:12.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:13.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:13.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:13.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:13.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:14.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:14.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:14.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:14.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:15.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:15.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:15.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:15.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:16.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:16.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:16.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:16.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:17.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:17.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:17.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:17.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:18.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:18.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:18.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:18.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:19.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:19.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:19.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:19.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:20.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:20.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:20.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:20.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:21.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:21.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:21.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:21.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:22.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:22.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:22.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:22.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:23.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:23.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:23.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:23.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:24.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:24.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:24.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:24.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:25.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:25.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:25.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:25.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:26.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:26.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:26.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:26.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:27.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:27.175+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:27.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:27.579+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:28.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:28.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:28.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:28.559+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:29.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:29.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:29.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:29.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:30.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:30.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:30.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:30.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:31.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:31.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:31.508 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:31.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:32.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:32.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:32.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:32.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:33.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:33.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:33.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:33.507+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:34.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:34.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:34.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:34.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:35.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:35.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:35.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:35.538+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:36.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:36.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:36.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:36.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:37.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:37.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:37.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:37.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:38.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:38.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:38.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:38.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:39.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:39.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:39.527 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:39.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:40.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:40.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:40.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:40.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:41.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:41.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:41.490 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:41.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:42.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:42.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:42.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:42.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:43.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:43.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:43.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:43.534+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:44.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:44.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:44.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:44.510+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:45.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:45.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:45.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:45.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:46.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:46.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:46.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:46.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:47.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:47.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:47.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:47.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:48.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:48.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:48.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:48.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:49.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:49.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:49.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:49.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:50.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:50.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:50.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:50.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:51.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:51.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:51.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:51.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:52.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:52.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:52.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:52.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:53.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:53.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:53.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:53.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:54.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:54.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:54.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:54.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:55.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:55.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:55.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:55.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:56.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:56.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:56.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:56.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:57.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:57.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:57.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:57.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:58.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:58.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:58.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:58.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:59.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T12:59:59.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T12:59:59.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T12:59:59.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:00.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:00.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:00.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:00.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:01.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:01.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:01.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:01.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:02.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:02.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:02.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:02.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:03.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:03.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:03.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:03.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:04.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:04.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:04.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:04.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:05.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:05.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:05.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:05.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:06.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:06.162+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:06.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:06.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:07.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:07.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:07.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:07.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:08.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:08.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:08.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:08.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:09.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:09.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:09.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:09.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:10.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:10.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:10.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:10.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:11.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:11.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:11.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:11.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:12.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:12.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:12.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:12.630+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:13.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:13.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:13.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:13.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:14.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:14.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:14.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:14.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:15.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:15.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:15.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:15.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:16.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:16.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:16.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:16.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:17.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:17.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:17.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:17.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:18.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:18.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:18.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:18.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:19.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:19.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:19.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:19.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:20.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:20.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:20.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:20.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:21.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:21.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:21.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:21.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:22.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:22.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:22.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:22.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:23.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:23.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:23.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:23.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:24.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:24.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:24.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:24.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:25.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:25.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:25.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:25.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:26.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:26.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:26.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:26.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:27.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:27.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:27.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:27.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:28.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:28.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:28.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:28.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:29.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:29.174+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:29.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:29.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:30.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:30.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:30.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:30.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:31.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:31.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:31.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:31.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:32.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:32.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:32.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:32.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:33.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:33.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:33.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:33.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:34.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:34.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:34.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:34.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:35.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:35.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:35.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:35.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:36.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:36.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:36.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:36.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:37.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:37.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:37.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:37.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:38.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:38.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:38.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:38.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:39.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:39.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:39.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:39.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:40.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:40.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:40.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:40.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:41.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:41.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:41.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:41.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:42.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:42.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:42.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:42.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:43.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:43.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:43.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:43.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:44.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:44.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:44.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:44.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:45.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:45.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:45.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:45.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:46.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:46.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:46.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:46.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:47.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:47.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:47.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:47.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:48.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:48.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:48.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:48.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:49.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:49.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:49.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:49.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:50.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:50.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:50.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:50.969+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:51.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:51.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:52.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:52.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:52.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:52.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:53.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:53.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:53.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:53.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:54.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:54.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:54.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:54.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:55.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:55.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:55.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:55.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:56.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:56.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:56.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:56.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:57.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:57.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:57.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:57.133+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:58.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:58.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:58.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:58.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:59.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:00:59.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:00:59.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:00:59.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:00.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:00.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:00.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:00.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:01.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:01.165+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:01.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:01.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:02.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:02.153+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:02.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:02.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:03.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:03.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:03.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:03.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:04.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:04.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:04.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:04.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:05.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:05.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:05.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:05.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:06.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:06.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:06.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:06.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:07.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:07.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:07.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:07.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:08.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:08.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:08.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:08.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:09.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:09.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:09.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:09.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:10.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:10.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:10.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:10.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:11.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:11.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:11.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:11.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:12.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:12.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:12.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:12.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:13.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:13.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:13.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:13.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:14.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:14.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:14.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:14.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:15.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:15.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:15.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:15.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:16.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:16.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:16.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:16.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:17.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:17.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:17.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:17.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:18.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:18.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:18.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:18.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:19.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:19.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:19.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:19.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:20.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:20.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:20.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:20.117+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:21.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:21.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:21.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:21.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:22.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:22.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:22.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:22.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:23.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:23.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:23.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:23.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:24.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:24.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:24.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:24.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:25.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:25.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:25.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:25.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:26.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:26.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:26.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:26.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:27.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:27.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:27.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:27.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:28.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:28.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:28.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:28.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:29.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:29.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:29.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:29.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:30.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:30.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:30.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:30.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:31.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:31.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:31.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:31.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:32.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:32.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:32.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:32.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:33.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:33.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:33.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:33.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:34.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:34.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:34.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:34.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:35.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:35.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:35.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:35.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:36.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:36.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:36.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:36.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:37.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:37.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:37.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:37.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:38.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:38.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:38.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:38.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:39.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:39.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:39.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:39.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:40.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:40.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:40.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:40.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:41.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:41.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:41.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:41.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:42.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:42.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:42.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:42.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:43.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:43.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:43.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:43.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:44.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:44.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:44.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:44.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:44.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:44.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:45.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:45.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:45.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:45.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:46.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:46.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:46.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:46.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:47.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:47.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:47.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:47.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:48.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:48.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:49.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:48.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:49.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:49.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:50.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:49.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:50.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:50.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:50.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:50.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:51.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:51.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:51.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:51.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:52.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:52.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:52.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:52.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:53.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:53.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:53.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:53.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:54.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:54.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:54.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:54.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:55.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:55.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:55.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:55.984+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:56.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:56.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:56.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:56.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:57.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:57.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:57.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:57.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:58.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:58.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:59.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:59.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:59.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:01:59.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:01:59.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:01:59.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:00.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:00.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:00.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:00.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:01.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:01.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:01.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:01.972+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:02.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:02.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:03.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:03.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:03.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:03.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:04.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:04.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:04.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:04.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:05.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:05.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:05.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:05.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:06.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:06.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:06.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:06.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:07.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:07.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:07.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:07.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:08.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:08.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:08.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:08.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:09.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:09.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:09.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:09.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:10.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:10.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:10.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:10.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:11.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:11.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:11.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:11.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:12.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:12.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:12.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:12.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:13.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:13.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:13.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:13.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:14.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:14.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:14.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:14.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:15.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:15.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:15.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:15.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:16.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:16.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:16.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:16.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:17.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:17.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:17.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:17.276+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:18.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:18.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:18.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:18.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:19.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:19.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:19.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:19.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:20.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:19.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:20.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:20.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:20.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:20.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:21.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:21.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:21.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:21.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:22.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:22.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:22.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:22.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:23.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:23.295+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:23.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:23.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:24.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:24.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:24.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:24.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:25.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:25.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:25.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:25.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:26.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:26.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:26.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:26.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:27.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:27.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:27.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:27.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:28.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:28.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:28.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:28.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:29.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:29.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:29.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:29.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:30.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:30.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:31.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:30.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:31.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:31.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:32.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:32.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:32.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:32.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:33.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:33.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:33.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:33.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:34.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:34.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:34.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:34.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:35.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:35.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:35.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:35.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:36.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:36.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:36.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:36.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:37.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:37.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:37.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:37.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:38.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:38.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:38.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:38.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:39.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:39.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:39.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:39.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:40.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:40.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:40.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:40.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:41.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:41.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:41.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:41.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:42.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:42.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:42.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:42.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:43.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:43.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:43.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:43.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:44.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:44.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:44.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:44.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:45.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:45.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:45.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:45.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:46.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:46.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:46.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:46.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:47.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:47.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:47.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:47.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:48.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:48.167+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:48.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:48.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:49.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:49.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:49.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:49.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:50.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:50.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:50.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:50.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:51.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:51.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:51.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:51.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:52.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:52.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:52.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:52.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:53.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:53.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:53.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:53.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:54.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:54.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:54.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:54.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:55.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:55.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:55.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:55.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:56.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:56.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:56.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:56.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:57.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:57.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:57.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:57.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:58.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:58.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:58.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:58.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:59.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:02:59.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:02:59.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:02:59.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:00.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:00.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:00.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:00.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:01.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:01.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:01.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:01.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:02.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:02.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:02.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:02.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:03.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:03.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:03.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:03.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:04.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:04.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:04.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:04.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:05.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:05.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:05.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:05.407+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:06.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:06.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:06.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:06.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:07.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:07.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:07.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:07.495+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:08.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:08.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:08.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:08.499+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:09.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:09.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:09.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:09.519+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:10.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:10.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:10.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:10.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:11.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:11.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:11.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:11.495+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:12.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:12.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:12.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:12.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:13.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:13.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:13.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:13.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:14.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:14.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:14.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:14.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:15.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:15.251+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:15.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:15.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:16.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:16.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:16.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:16.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:17.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:17.319+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:17.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:17.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:18.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:18.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:18.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:18.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:19.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:19.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:19.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:19.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:20.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:20.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:20.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:20.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:21.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:21.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:21.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:21.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:22.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:22.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:22.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:22.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:23.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:23.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:23.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:23.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:24.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:24.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:24.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:24.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:25.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:25.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:25.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:25.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:26.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:26.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:26.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:26.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:27.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:27.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:27.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:27.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:28.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:28.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:28.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:28.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:29.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:29.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:29.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:29.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:30.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:30.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:30.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:30.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:31.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:31.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:31.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:31.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:32.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:32.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:32.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:32.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:33.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:33.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:33.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:33.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:34.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:34.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:34.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:34.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:35.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:35.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:35.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:35.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:36.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:36.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:36.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:36.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:37.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:37.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:37.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:37.382+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:38.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:38.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:38.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:38.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:39.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:39.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:39.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:39.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:40.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:40.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:40.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:40.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:41.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:41.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:41.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:41.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:42.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:42.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:42.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:42.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:43.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:43.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:43.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:43.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:44.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:44.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:44.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:44.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:45.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:45.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:45.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:45.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:46.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:46.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:46.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:46.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:47.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:47.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:47.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:47.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:48.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:48.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:48.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:48.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:49.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:49.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:49.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:49.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:50.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:50.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:50.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:50.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:51.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:51.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:51.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:51.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:52.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:52.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:52.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:52.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:53.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:53.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:53.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:53.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:54.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:54.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:54.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:54.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:55.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:55.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:55.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:55.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:56.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:56.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:56.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:56.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:57.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:57.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:57.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:57.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:58.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:58.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:58.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:58.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:59.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:03:59.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:03:59.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:03:59.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:00.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:00.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:00.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:00.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:01.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:01.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:01.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:01.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:02.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:02.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:02.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:02.274+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:03.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:03.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:03.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:03.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:04.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:04.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:04.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:04.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:05.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:05.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:05.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:05.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:06.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:06.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:06.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:06.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:07.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:07.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:07.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:07.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:08.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:08.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:08.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:08.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:09.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:09.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:09.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:09.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:10.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:10.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:10.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:10.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:11.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:11.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:11.387 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:11.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:12.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:12.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:12.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:12.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:13.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:13.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:13.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:13.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:14.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:14.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:14.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:14.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:15.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:15.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:15.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:15.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:16.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:16.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:16.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:16.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:17.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:17.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:17.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:17.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:18.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:18.205+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:18.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:18.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:19.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:19.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:19.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:19.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:20.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:20.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:20.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:20.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:21.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:21.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:21.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:21.465+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:22.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:22.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:22.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:22.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:23.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:23.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:23.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:23.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:24.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:24.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:24.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:24.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:25.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:25.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:25.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:25.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:26.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:26.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:26.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:26.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:27.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:27.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:27.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:27.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:28.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:28.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:28.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:28.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:29.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:29.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:29.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:29.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:30.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:30.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:30.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:30.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:31.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:31.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:31.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:31.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:32.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:32.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:32.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:32.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:33.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:33.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:33.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:33.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:34.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:34.293+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:34.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:34.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:35.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:35.285+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:35.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:35.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:36.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:36.301+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:36.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:36.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:37.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:37.333+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:37.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:37.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:38.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:38.353+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:38.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:38.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:39.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:39.389+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:39.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:39.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:40.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:40.389+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:40.523 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:40.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:41.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:41.437+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:41.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:41.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:42.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:42.481+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:42.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:42.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:43.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:43.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:43.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:43.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:44.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:44.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:44.520 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:44.509+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:45.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:45.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:45.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:45.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:46.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:46.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:46.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:46.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:47.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:47.489+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:47.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:47.505+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:48.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:48.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:48.518 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:48.509+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:49.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:49.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:49.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:49.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:50.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:50.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:50.538 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:50.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:51.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:51.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:51.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:51.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:52.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:52.501+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:52.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:52.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:53.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:53.489+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:53.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:53.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:54.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:54.501+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:54.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:54.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:55.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:55.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:55.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:55.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:56.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:56.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:56.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:56.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:57.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:57.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:57.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:57.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:58.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:58.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:58.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:58.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:59.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:04:59.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:04:59.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:04:59.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:00.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:00.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:00.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:00.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:01.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:01.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:01.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:01.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:02.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:02.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:02.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:02.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:03.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:03.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:03.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:03.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:04.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:04.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:04.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:04.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:05.509 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:05.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:05.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:05.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:06.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:06.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:06.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:06.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:07.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:07.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:07.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:07.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:08.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:08.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:08.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:08.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:09.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:09.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:09.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:09.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:10.527 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:10.520+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:10.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:10.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:11.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:11.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:11.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:11.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:12.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:12.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:12.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:12.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:13.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:13.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:13.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:13.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:14.639 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:14.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:14.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:14.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:15.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:15.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:15.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:15.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:16.588 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:16.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:16.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:16.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:17.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:17.624+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:17.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:17.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:18.639 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:18.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:18.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:18.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:19.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:19.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:19.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:19.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:20.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:20.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:20.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:20.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:21.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:21.600+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:21.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:21.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:22.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:22.608+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:22.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:22.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:23.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:23.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:23.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:23.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:24.603 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:24.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:24.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:24.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:25.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:25.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:25.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:25.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:26.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:26.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:26.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:26.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:27.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:27.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:27.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:27.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:28.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:28.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:28.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:28.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:29.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:29.656+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:29.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:29.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:30.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:30.616+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:30.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:30.624+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:31.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:31.640+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:31.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:31.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:32.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:32.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:32.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:32.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:33.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:33.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:33.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:33.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:34.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:34.728+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:34.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:34.764+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:35.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:35.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:35.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:35.760+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:36.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:36.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:36.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:36.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:37.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:37.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:37.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:37.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:38.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:38.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:38.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:38.756+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:39.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:39.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:39.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:39.772+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:40.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:40.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:40.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:40.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:41.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:41.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:41.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:41.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:42.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:42.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:42.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:42.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:43.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:43.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:43.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:43.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:44.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:44.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:44.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:44.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:45.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:45.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:45.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:45.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:46.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:46.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:46.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:46.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:47.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:47.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:47.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:47.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:48.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:48.672+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:48.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:48.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:49.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:49.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:49.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:49.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:50.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:50.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:50.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:50.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:51.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:51.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:51.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:51.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:52.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:52.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:52.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:52.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:53.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:53.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:53.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:53.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:54.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:54.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:54.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:54.780+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:55.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:55.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:55.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:55.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:56.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:56.628+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:56.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:56.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:57.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:57.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:57.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:57.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:58.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:58.612+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:58.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:58.868+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:59.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:05:59.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:05:59.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:05:59.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:00.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:00.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:00.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:00.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:01.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:01.547+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:01.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:01.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:02.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:02.599+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:02.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:02.879+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:03.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:03.595+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:03.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:03.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:04.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:04.639+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:04.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:04.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:05.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:05.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:05.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:05.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:06.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:06.615+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:06.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:06.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:07.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:07.615+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:07.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:07.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:08.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:08.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:08.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:08.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:09.618 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:09.611+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:09.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:09.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:10.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:10.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:10.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:10.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:11.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:11.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:11.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:11.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:12.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:12.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:12.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:12.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:13.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:13.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:13.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:13.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:14.657 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:14.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:14.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:14.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:15.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:15.675+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:15.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:15.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:16.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:16.655+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:16.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:16.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:17.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:17.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:17.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:17.795+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:18.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:18.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:18.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:18.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:19.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:19.591+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:19.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:19.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:20.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:20.563+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:20.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:20.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:21.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:21.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:21.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:21.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:22.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:22.535+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:22.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:22.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:23.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:23.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:23.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:23.767+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:24.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:24.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:24.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:24.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:25.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:25.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:25.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:25.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:26.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:26.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:26.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:26.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:27.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:27.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:27.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:27.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:28.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:28.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:28.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:28.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:29.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:29.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:29.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:29.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:30.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:30.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:30.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:30.827+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:31.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:31.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:31.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:31.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:32.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:32.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:32.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:32.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:33.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:33.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:33.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:33.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:34.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:34.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:34.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:34.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:35.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:35.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:35.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:35.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:36.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:36.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:36.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:36.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:37.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:37.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:37.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:37.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:38.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:38.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:38.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:38.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:39.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:39.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:39.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:39.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:40.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:40.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:40.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:40.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:41.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:41.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:41.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:41.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:42.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:42.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:42.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:42.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:43.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:43.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:43.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:43.751+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:44.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:44.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:44.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:44.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:45.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:45.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:45.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:45.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:46.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:46.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:46.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:46.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:47.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:47.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:47.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:47.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:48.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:48.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:48.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:48.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:49.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:49.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:49.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:49.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:50.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:50.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:50.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:50.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:51.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:51.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:51.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:51.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:52.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:52.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:52.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:52.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:53.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:53.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:53.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:53.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:54.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:54.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:54.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:54.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:55.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:55.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:55.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:55.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:56.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:56.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:56.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:56.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:57.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:57.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:57.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:57.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:58.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:58.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:58.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:58.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:59.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:06:59.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:06:59.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:06:59.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:00.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:00.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:00.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:00.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:01.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:01.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:01.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:01.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:02.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:02.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:02.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:02.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:03.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:03.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:03.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:03.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:04.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:04.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:04.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:04.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:05.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:05.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:05.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:05.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:05.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:05.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:06.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:06.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:06.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:06.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:07.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:07.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:08.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:07.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:08.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:08.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:09.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:09.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:09.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:09.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:09.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:09.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:10.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:10.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:10.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:10.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:11.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:11.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:12.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:12.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:12.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:12.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:12.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:12.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:13.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:13.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:13.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:13.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:14.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:14.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:14.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:14.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:15.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:15.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:15.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:15.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:16.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:16.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:16.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:16.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:17.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:17.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:17.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:17.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:18.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:18.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:18.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:18.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:19.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:19.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:19.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:19.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:20.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:20.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:20.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:20.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:21.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:21.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:21.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:21.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:22.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:22.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:22.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:22.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:23.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:23.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:23.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:23.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:24.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:24.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:24.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:24.798+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:25.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:25.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:25.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:25.786+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:26.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:26.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:26.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:26.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:27.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:27.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:27.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:27.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:28.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:28.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:28.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:28.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:29.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:29.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:29.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:29.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:30.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:30.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:30.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:30.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:31.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:31.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:31.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:31.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:32.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:32.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:32.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:32.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:33.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:33.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:33.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:33.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:34.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:34.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:35.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:34.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:35.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:35.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:35.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:35.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:36.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:36.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:37.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:36.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:37.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:37.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:38.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:38.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:38.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:38.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:39.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:39.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:39.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:39.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:40.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:40.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:40.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:40.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:41.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:40.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:41.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:41.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:42.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:41.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:42.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:42.538+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:43.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:43.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:43.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:43.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:44.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:44.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:44.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:44.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:45.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:45.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:45.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:45.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:46.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:46.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:46.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:46.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:47.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:47.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:47.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:47.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:48.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:48.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:48.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:48.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:49.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:49.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:49.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:49.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:50.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:50.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:50.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:50.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:51.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:51.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:51.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:51.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:51.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:51.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:52.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:52.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:53.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:53.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:53.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:53.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:53.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:53.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:54.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:54.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:55.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:54.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:55.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:55.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:55.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:55.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:56.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:56.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:56.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:56.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:57.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:57.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:57.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:57.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:58.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:58.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:58.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:58.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:59.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:07:59.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:07:59.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:07:59.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:00.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:00.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:00.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:00.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:01.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:01.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:01.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:01.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:02.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:02.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:02.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:02.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:03.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:03.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:03.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:03.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:04.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:04.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:05.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:05.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:05.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:05.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:05.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:05.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:06.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:06.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:07.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:06.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:07.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:07.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:07.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:07.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:08.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:08.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:08.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:08.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:09.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:09.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:09.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:09.917+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:10.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:10.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:10.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:10.917+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:11.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:11.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:11.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:11.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:12.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:12.481+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:12.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:12.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:13.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:13.501+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:13.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:13.937+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:14.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:14.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:14.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:14.901+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:15.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:15.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:15.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:15.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:16.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:16.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:16.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:16.833+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:17.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:17.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:17.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:17.881+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:18.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:18.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:18.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:18.845+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:19.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:19.485+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:19.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:19.897+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:20.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:20.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:20.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:20.917+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:21.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:21.501+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:21.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:21.881+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:22.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:22.477+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:22.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:22.893+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:23.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:23.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:23.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:23.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:24.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:24.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:24.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:24.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:25.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:25.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:25.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:25.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:26.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:26.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:26.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:26.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:27.527 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:27.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:27.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:27.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:28.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:28.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:28.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:28.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:29.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:29.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:29.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:29.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:30.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:30.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:30.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:30.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:31.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:31.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:31.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:31.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:32.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:32.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:33.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:33.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:33.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:33.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:34.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:34.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:34.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:34.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:35.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:35.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:35.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:35.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:36.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:36.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:36.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:36.609+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:37.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:37.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:37.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:37.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:37.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:37.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:38.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:38.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:39.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:39.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:39.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:39.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:40.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:40.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:40.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:40.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:41.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:41.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:41.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:41.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:41.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:41.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:42.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:42.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:43.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:43.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:43.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:43.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:43.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:43.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:44.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:44.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:44.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:44.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:45.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:45.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:46.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:46.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:46.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:46.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:47.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:47.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:47.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:47.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:47.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:47.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:48.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:48.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:48.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:48.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:49.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:49.640+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:49.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:49.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:50.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:50.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:50.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:50.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:51.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:51.648+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:51.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:51.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:52.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:52.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:52.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:52.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:53.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:53.640+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:53.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:53.872+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:54.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:54.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:54.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:54.876+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:55.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:55.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:55.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:55.836+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:56.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:56.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:56.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:56.812+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:57.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:57.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:57.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:57.784+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:58.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:58.580+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:58.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:58.828+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:59.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:08:59.580+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:08:59.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:08:59.856+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:00.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:00.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:00.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:00.904+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:01.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:01.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:01.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:01.860+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:02.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:02.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:02.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:02.904+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:03.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:03.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:03.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:03.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:04.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:04.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:05.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:04.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:05.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:05.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:06.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:06.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:06.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:06.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:06.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:06.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:07.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:07.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:07.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:07.912+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:08.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:08.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:08.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:08.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:09.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:09.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:09.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:09.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:10.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:10.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:10.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:10.868+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:11.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:11.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:11.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:11.876+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:12.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:12.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:12.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:12.864+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:13.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:13.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:13.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:13.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:14.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:14.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:14.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:14.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:15.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:15.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:15.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:15.904+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:16.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:16.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:16.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:16.928+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:17.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:17.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:17.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:17.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:18.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:18.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:18.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:18.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:19.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:19.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:19.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:19.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:20.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:20.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:20.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:20.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:21.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:21.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:21.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:21.880+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:22.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:22.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:22.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:22.896+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:23.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:23.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:23.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:23.912+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:24.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:24.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:24.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:24.952+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:25.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:25.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:25.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:25.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:26.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:26.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:26.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:26.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:27.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:27.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:27.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:27.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:28.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:28.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:28.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:28.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:29.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:29.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:30.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:29.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:30.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:30.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:30.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:30.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:31.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:31.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:32.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:32.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:32.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:32.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:33.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:33.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:33.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:33.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:34.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:34.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:34.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:34.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:35.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:35.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:35.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:35.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:36.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:36.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:36.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:36.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:37.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:37.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:37.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:37.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:38.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:38.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:38.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:38.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:39.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:39.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:39.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:39.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:40.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:40.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:40.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:40.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:41.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:41.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:41.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:41.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:42.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:42.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:42.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:42.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:43.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:43.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:43.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:43.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:44.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:44.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:44.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:44.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:45.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:45.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:45.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:45.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:46.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:46.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:46.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:46.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:47.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:47.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:47.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:47.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:47.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:47.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:48.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:48.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:48.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:48.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:49.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:49.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:49.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:49.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:50.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:50.819+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:50.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:50.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:51.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:51.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:51.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:51.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:52.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:52.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:52.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:52.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:53.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:53.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:53.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:53.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:54.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:54.819+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:54.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:54.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:55.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:55.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:55.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:55.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:56.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:56.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:56.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:56.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:57.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:57.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:58.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:58.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:58.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:58.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:59.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:09:58.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:09:59.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:09:59.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:00.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:00.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:00.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:00.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:01.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:01.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:01.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:01.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:02.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:02.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:02.699 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:02.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:03.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:03.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:03.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:03.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:04.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:04.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:04.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:04.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:05.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:05.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:05.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:05.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:06.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:06.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:06.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:06.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:07.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:07.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:07.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:07.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:07.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:07.979+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:08.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:08.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:09.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:08.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:09.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:09.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:10.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:09.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:10.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:10.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:11.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:11.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:11.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:11.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:12.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:12.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:12.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:12.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:12.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:12.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:13.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:13.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:14.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:14.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:14.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:14.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:14.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:14.967+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:15.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:15.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:15.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:15.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:16.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:16.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:16.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:16.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:17.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:17.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:17.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:17.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:18.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:18.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:18.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:18.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:19.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:19.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:19.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:19.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:20.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:20.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:20.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:20.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:21.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:21.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:21.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:21.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:22.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:22.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:22.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:22.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:23.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:23.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:23.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:23.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:24.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:24.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:24.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:24.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:25.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:25.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:25.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:25.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:26.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:26.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:26.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:26.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:27.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:27.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:27.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:27.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:28.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:28.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:28.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:28.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:29.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:29.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:29.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:29.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:30.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:30.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:30.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:30.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:31.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:31.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:31.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:31.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:32.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:32.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:32.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:32.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:33.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:33.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:33.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:33.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:34.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:34.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:34.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:34.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:35.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:35.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:35.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:35.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:36.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:36.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:36.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:36.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:37.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:37.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:37.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:37.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:38.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:38.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:39.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:39.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:39.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:39.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:40.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:40.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:40.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:40.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:41.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:41.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:41.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:41.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:42.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:42.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:42.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:42.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:43.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:43.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:43.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:43.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:44.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:44.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:44.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:44.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:45.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:45.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:45.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:45.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:46.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:46.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:46.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:46.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:47.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:47.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:47.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:47.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:48.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:48.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:48.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:48.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:49.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:49.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:49.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:49.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:50.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:50.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:50.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:50.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:51.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:51.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:51.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:51.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:52.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:52.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:52.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:52.670+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:53.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:53.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:53.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:53.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:54.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:54.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:54.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:54.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:55.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:55.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:55.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:55.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:56.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:56.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:56.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:56.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:57.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:57.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:57.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:57.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:58.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:58.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:58.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:58.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:59.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:10:59.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:10:59.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:10:59.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:00.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:00.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:00.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:00.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:01.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:01.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:01.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:01.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:02.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:02.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:02.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:02.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:03.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:03.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:03.585 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:03.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:04.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:04.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:04.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:04.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:05.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:05.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:05.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:05.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:06.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:06.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:06.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:06.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:07.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:07.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:07.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:07.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:08.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:08.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:08.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:08.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:09.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:09.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:09.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:09.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:10.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:10.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:10.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:10.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:11.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:11.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:11.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:11.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:12.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:12.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:12.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:12.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:13.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:13.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:13.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:13.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:14.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:14.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:14.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:14.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:15.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:15.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:15.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:15.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:16.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:16.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:16.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:16.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:17.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:17.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:17.791 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:17.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:18.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:18.174+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:18.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:18.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:19.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:19.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:19.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:19.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:20.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:20.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:20.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:20.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:21.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:21.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:21.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:21.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:22.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:22.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:22.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:22.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:23.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:23.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:23.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:23.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:24.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:24.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:24.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:24.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:25.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:25.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:25.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:25.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:26.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:26.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:26.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:26.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:27.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:27.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:27.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:27.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:28.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:28.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:28.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:28.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:29.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:29.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:29.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:29.709+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:30.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:30.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:30.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:30.721+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:31.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:31.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:31.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:31.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:32.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:32.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:32.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:32.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:33.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:33.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:33.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:33.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:34.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:34.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:34.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:34.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:35.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:35.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:35.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:35.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:36.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:36.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:36.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:36.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:37.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:37.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:37.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:37.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:38.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:38.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:38.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:38.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:39.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:39.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:39.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:39.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:40.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:40.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:40.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:40.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:41.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:41.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:41.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:41.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:42.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:42.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:42.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:42.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:43.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:43.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:43.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:43.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:44.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:44.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:44.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:44.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:45.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:45.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:45.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:45.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:46.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:46.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:46.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:46.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:47.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:47.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:47.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:47.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:48.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:48.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:48.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:48.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:49.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:49.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:49.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:49.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:50.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:50.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:50.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:50.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:51.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:51.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:51.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:51.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:52.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:52.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:52.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:52.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:53.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:53.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:53.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:53.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:54.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:54.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:54.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:54.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:55.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:55.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:55.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:55.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:56.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:55.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:56.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:56.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:56.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:56.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:57.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:57.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:57.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:57.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:58.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:58.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:58.941 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:58.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:59.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:11:59.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:11:59.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:11:59.917+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:00.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:00.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:00.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:00.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:01.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:01.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:01.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:01.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:02.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:02.833+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:02.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:02.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:03.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:03.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:03.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:03.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:04.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:04.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:04.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:04.825+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:05.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:05.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:05.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:05.849+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:06.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:06.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:06.895 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:06.885+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:07.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:07.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:07.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:07.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:08.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:08.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:08.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:08.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:09.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:09.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:09.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:09.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:10.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:10.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:11.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:11.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:11.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:11.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:12.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:12.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:12.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:12.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:12.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:12.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:13.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:13.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:14.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:14.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:14.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:14.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:15.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:15.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:15.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:15.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:15.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:15.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:16.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:16.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:17.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:17.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:17.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:17.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:18.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:18.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:18.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:18.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:19.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:19.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:19.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:19.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:20.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:20.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:21.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:21.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:21.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:21.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:22.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:22.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:22.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:22.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:23.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:23.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:23.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:23.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:24.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:24.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:24.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:24.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:25.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:25.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:25.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:25.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:26.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:26.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:26.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:26.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:27.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:27.092+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:27.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:27.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:28.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:28.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:28.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:28.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:29.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:29.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:29.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:29.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:30.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:30.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:30.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:30.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:31.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:31.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:31.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:31.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:32.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:32.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:32.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:32.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:33.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:33.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:33.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:33.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:34.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:34.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:34.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:34.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:35.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:35.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:35.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:35.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:36.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:36.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:36.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:36.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:37.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:37.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:37.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:37.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:38.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:38.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:38.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:38.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:39.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:39.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:39.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:39.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:40.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:40.092+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:40.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:40.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:41.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:41.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:41.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:41.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:42.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:42.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:42.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:42.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:43.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:42.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:43.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:43.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:44.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:44.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:44.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:44.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:44.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:44.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:45.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:45.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:45.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:45.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:46.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:46.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:46.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:46.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:47.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:47.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:47.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:47.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:48.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:48.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:48.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:48.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:49.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:49.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:49.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:49.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:50.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:50.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:50.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:50.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:51.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:51.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:51.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:51.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:52.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:52.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:52.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:52.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:53.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:53.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:53.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:53.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:54.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:54.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:54.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:54.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:55.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:55.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:55.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:55.832+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:56.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:56.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:56.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:56.816+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:57.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:57.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:57.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:57.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:58.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:58.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:58.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:58.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:59.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:12:59.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:12:59.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:12:59.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:00.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:00.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:00.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:00.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:01.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:01.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:01.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:01.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:02.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:02.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:02.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:02.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:03.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:03.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:03.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:03.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:04.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:04.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:04.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:04.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:05.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:05.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:05.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:05.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:06.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:06.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:06.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:06.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:07.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:07.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:07.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:07.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:08.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:08.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:08.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:08.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:09.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:09.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:09.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:09.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:10.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:10.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:10.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:10.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:11.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:11.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:11.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:11.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:12.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:12.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:12.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:12.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:13.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:13.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:14.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:14.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:14.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:14.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:15.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:15.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:15.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:15.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:16.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:16.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:16.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:16.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:17.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:17.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:17.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:17.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:18.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:18.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:18.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:18.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:19.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:19.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:19.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:19.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:20.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:20.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:20.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:20.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:21.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:21.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:21.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:21.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:22.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:22.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:22.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:22.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:23.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:23.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:23.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:23.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:24.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:24.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:24.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:24.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:25.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:24.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:25.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:25.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:26.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:26.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:26.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:26.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:27.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:27.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:27.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:27.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:28.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:28.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:28.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:28.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:29.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:29.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:29.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:29.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:30.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:30.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:30.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:30.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:31.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:31.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:31.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:31.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:32.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:32.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:32.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:32.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:33.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:33.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:33.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:33.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:34.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:34.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:34.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:34.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:35.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:35.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:35.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:35.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:36.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:36.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:36.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:36.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:37.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:37.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:37.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:37.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:38.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:38.115+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:38.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:38.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:39.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:39.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:39.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:39.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:40.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:40.155+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:40.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:40.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:41.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:41.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:41.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:41.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:42.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:42.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:42.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:42.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:43.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:43.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:43.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:43.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:44.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:44.115+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:44.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:44.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:45.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:45.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:45.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:45.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:46.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:46.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:46.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:46.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:47.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:47.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:47.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:47.423+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:48.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:48.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:48.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:48.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:49.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:49.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:49.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:49.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:50.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:50.195+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:50.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:50.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:51.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:51.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:51.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:51.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:52.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:52.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:52.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:52.423+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:53.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:53.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:53.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:53.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:54.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:54.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:54.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:54.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:55.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:55.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:55.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:55.487+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:56.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:56.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:56.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:56.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:57.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:57.167+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:57.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:57.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:58.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:58.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:58.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:58.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:59.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:13:59.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:13:59.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:13:59.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:00.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:00.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:00.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:00.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:01.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:01.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:01.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:01.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:02.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:02.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:02.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:02.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:03.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:03.115+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:03.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:03.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:04.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:04.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:04.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:04.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:05.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:05.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:05.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:05.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:06.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:06.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:06.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:06.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:07.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:07.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:07.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:07.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:08.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:08.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:08.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:08.539+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:09.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:09.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:09.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:09.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:10.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:10.195+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:10.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:10.547+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:11.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:11.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:11.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:11.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:12.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:12.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:12.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:12.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:13.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:13.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:13.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:13.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:14.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:14.259+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:14.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:14.499+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:15.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:15.287+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:15.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:15.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:16.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:16.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:16.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:16.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:17.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:17.303+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:17.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:17.471+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:18.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:18.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:18.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:18.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:19.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:19.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:19.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:19.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:20.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:20.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:20.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:20.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:21.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:21.330+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:21.514 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:21.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:22.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:22.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:22.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:22.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:23.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:23.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:23.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:23.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:24.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:24.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:24.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:24.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:25.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:25.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:25.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:25.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:26.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:26.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:26.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:26.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:27.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:27.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:27.560 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:27.550+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:28.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:28.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:28.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:28.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:29.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:29.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:29.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:29.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:30.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:30.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:30.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:30.462+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:31.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:31.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:31.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:31.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:32.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:32.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:32.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:32.474+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:33.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:33.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:33.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:33.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:34.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:34.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:34.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:34.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:35.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:35.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:35.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:35.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:36.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:36.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:36.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:36.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:37.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:37.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:37.611 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:37.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:38.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:38.178+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:38.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:38.574+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:39.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:39.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:39.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:39.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:40.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:40.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:40.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:40.522+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:41.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:41.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:41.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:41.550+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:42.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:42.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:42.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:42.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:43.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:43.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:43.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:43.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:44.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:44.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:44.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:44.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:45.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:45.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:45.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:45.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:46.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:46.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:46.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:46.498+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:47.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:47.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:47.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:47.462+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:48.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:48.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:48.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:48.462+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:49.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:49.170+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:49.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:49.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:50.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:50.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:50.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:50.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:51.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:51.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:51.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:51.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:52.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:52.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:52.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:52.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:53.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:53.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:53.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:53.486+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:54.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:54.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:54.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:54.498+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:55.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:55.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:55.527 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:55.518+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:56.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:56.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:56.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:56.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:57.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:57.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:57.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:57.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:58.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:58.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:58.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:58.542+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:59.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:14:59.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:14:59.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:14:59.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:00.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:00.238+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:00.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:00.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:01.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:01.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:01.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:01.554+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:02.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:02.174+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:02.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:02.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:03.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:03.222+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:03.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:03.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:04.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:04.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:04.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:04.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:05.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:05.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:05.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:05.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:06.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:06.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:06.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:06.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:07.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:07.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:07.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:07.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:08.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:08.370+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:08.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:08.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:09.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:09.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:09.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:09.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:10.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:10.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:10.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:10.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:11.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:11.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:11.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:11.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:12.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:12.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:12.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:12.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:13.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:13.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:13.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:13.534+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:14.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:14.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:14.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:14.558+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:15.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:15.285+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:15.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:15.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:16.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:16.329+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:16.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:16.593+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:17.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:17.309+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:17.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:17.553+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:18.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:18.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:18.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:18.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:19.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:19.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:19.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:19.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:20.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:20.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:20.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:20.593+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:21.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:21.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:21.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:21.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:22.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:22.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:22.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:22.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:23.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:23.249+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:23.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:23.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:24.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:24.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:24.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:24.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:25.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:25.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:25.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:25.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:26.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:26.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:26.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:26.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:27.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:27.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:27.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:27.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:28.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:28.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:28.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:28.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:29.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:29.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:29.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:29.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:30.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:30.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:30.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:30.553+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:31.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:31.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:31.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:31.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:32.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:32.165+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:32.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:32.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:33.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:33.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:33.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:33.605+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:34.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:34.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:34.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:34.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:35.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:35.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:35.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:35.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:36.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:36.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:36.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:36.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:37.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:37.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:37.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:37.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:38.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:38.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:38.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:38.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:39.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:39.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:39.509 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:39.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:40.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:40.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:40.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:40.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:41.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:41.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:41.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:41.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:42.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:42.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:42.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:42.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:43.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:43.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:43.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:43.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:44.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:44.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:44.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:44.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:45.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:45.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:45.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:45.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:46.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:46.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:46.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:46.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:47.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:47.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:47.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:47.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:48.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:48.153+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:48.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:48.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:49.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:49.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:49.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:49.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:50.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:50.197+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:50.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:50.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:51.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:51.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:51.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:51.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:52.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:52.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:52.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:52.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:53.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:53.205+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:53.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:53.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:54.201 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:54.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:54.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:54.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:55.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:55.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:55.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:55.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:56.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:56.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:56.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:56.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:57.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:57.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:57.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:57.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:58.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:58.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:58.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:58.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:59.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:15:59.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:15:59.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:15:59.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:00.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:00.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:00.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:00.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:01.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:01.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:01.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:01.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:02.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:02.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:02.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:02.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:03.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:03.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:03.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:03.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:04.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:04.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:04.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:04.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:05.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:05.289+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:05.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:05.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:06.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:06.273+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:06.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:06.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:07.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:07.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:07.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:07.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:08.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:08.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:08.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:08.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:09.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:09.337+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:09.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:09.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:10.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:10.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:10.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:10.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:11.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:11.333+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:11.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:11.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:12.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:12.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:12.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:12.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:13.413 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:13.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:13.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:13.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:14.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:14.368+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:14.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:14.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:15.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:15.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:15.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:15.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:16.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:16.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:16.588 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:16.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:17.430 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:17.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:17.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:17.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:18.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:18.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:18.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:18.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:19.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:19.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:19.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:19.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:20.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:20.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:20.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:20.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:21.409 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:21.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:21.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:21.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:22.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:22.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:22.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:22.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:23.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:23.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:23.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:23.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:24.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:24.368+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:24.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:24.552+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:25.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:25.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:25.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:25.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:26.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:26.368+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:26.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:26.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:27.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:27.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:27.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:27.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:28.431 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:28.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:28.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:28.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:29.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:29.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:29.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:29.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:30.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:30.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:30.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:30.516+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:31.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:31.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:31.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:31.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:32.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:32.528+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:32.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:32.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:33.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:33.504+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:33.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:33.540+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:34.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:34.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:34.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:34.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:35.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:35.524+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:35.539 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:35.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:36.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:36.536+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:36.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:36.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:37.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:37.536+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:37.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:37.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:38.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:38.528+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:38.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:38.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:39.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:39.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:39.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:39.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:40.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:40.544+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:40.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:40.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:41.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:41.536+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:41.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:41.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:42.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:42.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:42.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:42.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:43.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:43.616+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:43.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:43.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:44.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:44.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:44.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:44.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:45.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:45.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:45.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:45.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:46.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:46.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:46.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:46.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:47.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:47.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:47.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:47.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:48.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:48.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:48.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:48.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:49.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:49.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:49.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:49.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:50.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:50.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:50.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:50.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:51.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:51.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:51.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:51.672+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:52.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:52.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:52.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:52.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:53.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:53.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:53.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:53.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:54.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:54.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:54.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:54.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:55.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:55.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:55.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:55.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:56.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:56.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:56.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:56.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:57.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:57.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:57.746 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:57.740+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:58.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:58.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:58.712 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:58.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:59.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:16:59.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:16:59.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:16:59.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:00.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:00.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:00.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:00.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:01.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:01.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:01.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:01.740+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:02.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:02.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:02.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:02.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:03.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:03.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:03.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:03.760+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:04.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:04.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:04.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:04.764+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:05.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:05.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:05.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:05.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:06.727 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:06.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:06.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:06.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:07.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:07.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:07.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:07.772+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:08.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:08.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:08.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:08.820+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:09.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:09.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:09.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:09.820+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:10.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:10.656+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:10.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:10.788+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:11.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:11.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:11.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:11.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:12.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:12.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:12.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:12.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:13.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:13.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:13.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:13.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:14.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:14.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:14.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:14.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:15.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:15.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:15.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:15.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:16.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:16.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:16.895 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:16.887+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:17.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:17.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:17.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:17.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:18.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:18.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:18.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:18.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:19.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:19.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:19.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:19.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:20.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:20.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:20.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:20.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:21.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:21.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:21.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:21.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:22.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:22.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:22.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:22.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:23.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:23.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:23.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:23.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:24.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:24.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:25.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:24.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:25.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:25.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:26.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:26.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:26.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:26.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:27.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:27.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:27.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:27.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:28.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:28.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:28.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:28.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:29.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:29.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:29.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:29.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:30.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:30.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:30.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:30.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:31.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:31.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:31.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:31.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:32.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:32.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:32.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:32.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:33.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:33.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:33.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:33.655+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:34.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:34.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:34.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:34.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:35.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:35.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:35.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:35.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:36.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:36.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:36.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:36.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:37.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:37.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:37.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:37.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:38.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:38.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:38.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:38.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:39.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:39.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:39.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:39.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:40.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:40.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:40.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:40.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:41.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:41.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:41.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:41.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:42.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:42.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:42.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:42.767+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:43.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:43.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:43.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:43.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:44.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:44.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:44.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:44.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:45.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:45.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:45.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:45.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:46.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:46.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:46.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:46.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:47.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:47.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:47.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:47.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:48.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:48.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:48.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:48.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:49.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:49.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:49.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:49.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:50.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:50.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:50.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:50.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:51.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:51.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:51.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:51.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:52.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:52.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:52.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:52.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:53.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:53.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:53.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:53.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:54.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:54.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:54.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:54.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:55.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:55.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:55.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:55.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:56.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:56.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:56.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:56.619+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:57.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:57.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:57.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:57.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:58.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:58.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:58.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:58.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:59.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:17:59.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:17:59.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:17:59.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:00.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:00.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:00.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:00.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:01.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:01.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:01.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:01.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:02.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:02.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:02.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:02.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:03.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:03.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:03.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:03.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:04.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:04.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:04.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:04.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:05.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:05.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:05.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:05.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:06.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:06.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:06.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:06.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:07.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:07.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:07.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:07.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:08.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:08.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:08.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:08.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:09.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:09.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:09.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:09.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:10.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:10.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:10.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:10.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:11.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:11.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:11.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:11.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:12.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:12.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:12.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:12.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:13.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:13.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:13.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:13.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:14.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:14.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:14.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:14.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:15.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:15.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:15.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:15.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:16.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:16.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:16.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:16.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:17.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:17.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:17.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:17.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:18.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:18.114+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:18.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:18.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:19.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:19.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:19.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:19.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:20.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:20.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:20.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:20.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:21.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:21.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:21.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:21.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:22.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:22.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:22.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:22.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:23.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:23.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:23.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:23.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:24.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:24.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:24.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:24.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:25.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:25.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:25.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:25.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:26.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:26.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:26.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:26.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:27.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:27.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:27.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:27.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:28.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:28.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:28.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:28.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:29.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:29.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:29.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:29.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:30.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:30.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:30.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:30.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:31.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:31.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:31.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:31.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:32.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:32.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:32.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:32.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:33.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:33.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:33.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:33.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:34.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:34.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:34.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:34.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:35.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:35.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:35.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:35.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:36.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:36.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:36.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:36.786+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:37.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:37.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:37.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:37.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:38.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:38.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:38.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:38.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:39.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:39.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:39.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:39.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:40.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:40.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:40.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:40.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:41.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:41.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:41.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:41.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:42.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:42.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:42.690 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:42.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:43.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:43.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:43.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:43.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:44.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:44.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:44.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:44.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:45.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:45.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:45.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:45.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:46.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:46.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:46.603 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:46.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:47.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:47.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:47.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:47.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:48.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:48.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:48.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:48.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:49.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:49.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:49.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:49.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:50.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:50.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:50.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:50.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:51.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:51.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:51.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:51.634+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:52.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:52.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:52.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:52.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:53.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:53.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:53.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:53.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:54.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:54.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:54.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:54.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:55.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:55.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:55.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:55.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:56.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:56.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:56.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:56.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:57.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:57.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:57.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:57.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:58.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:58.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:58.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:58.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:59.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:18:59.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:18:59.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:18:59.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:00.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:00.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:00.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:00.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:01.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:01.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:01.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:01.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:02.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:02.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:02.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:02.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:03.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:03.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:03.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:03.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:04.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:04.394+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:04.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:04.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:05.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:05.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:05.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:05.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:06.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:06.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:06.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:06.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:07.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:07.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:07.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:07.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:08.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:08.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:08.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:08.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:09.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:09.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:09.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:09.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:10.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:10.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:10.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:10.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:11.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:11.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:11.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:11.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:12.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:12.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:12.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:12.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:13.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:13.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:13.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:13.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:14.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:14.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:14.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:14.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:15.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:15.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:15.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:15.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:16.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:16.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:16.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:16.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:17.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:17.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:17.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:17.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:18.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:18.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:18.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:18.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:19.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:19.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:19.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:19.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:20.544 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:20.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:20.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:20.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:21.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:21.581+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:21.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:21.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:22.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:22.537+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:22.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:22.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:23.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:23.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:24.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:24.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:24.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:24.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:25.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:25.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:25.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:25.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:26.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:26.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:26.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:26.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:27.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:27.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:27.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:27.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:28.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:28.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:28.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:28.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:29.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:29.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:29.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:29.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:30.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:30.133+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:30.573 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:30.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:31.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:31.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:31.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:31.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:32.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:32.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:32.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:32.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:33.201 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:33.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:33.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:33.585+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:34.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:34.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:34.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:34.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:35.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:35.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:35.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:35.621+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:36.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:36.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:36.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:36.633+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:37.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:37.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:37.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:37.593+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:38.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:38.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:38.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:38.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:39.202 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:39.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:39.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:39.601+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:40.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:40.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:40.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:40.617+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:41.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:41.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:41.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:41.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:42.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:42.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:42.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:42.597+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:43.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:43.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:43.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:43.645+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:44.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:44.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:44.705 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:44.697+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:45.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:45.225+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:45.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:45.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:46.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:46.273+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:46.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:46.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:47.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:47.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:47.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:47.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:48.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:48.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:48.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:48.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:49.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:49.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:49.733 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:49.725+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:50.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:50.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:50.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:50.741+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:51.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:51.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:51.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:51.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:52.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:52.273+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:52.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:52.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:53.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:53.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:53.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:53.765+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:54.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:54.269+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:54.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:54.805+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:55.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:55.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:55.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:55.805+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:56.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:56.253+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:56.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:56.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:57.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:57.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:57.821 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:57.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:58.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:58.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:58.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:58.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:59.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:19:59.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:19:59.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:19:59.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:00.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:00.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:00.800 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:00.793+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:01.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:01.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:01.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:01.777+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:02.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:02.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:02.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:02.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:03.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:03.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:03.766 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:03.761+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:04.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:04.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:04.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:04.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:05.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:05.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:05.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:05.824+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:06.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:06.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:06.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:06.864+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:07.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:07.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:07.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:07.860+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:08.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:08.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:08.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:08.888+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:09.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:09.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:09.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:09.848+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:10.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:10.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:10.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:10.880+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:11.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:11.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:11.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:11.848+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:12.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:12.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:12.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:12.804+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:13.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:13.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:13.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:13.848+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:14.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:14.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:14.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:14.856+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:15.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:15.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:15.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:15.868+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:16.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:16.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:16.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:16.844+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:17.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:17.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:17.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:17.876+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:18.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:18.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:18.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:18.872+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:19.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:19.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:19.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:19.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:20.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:20.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:20.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:20.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:21.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:21.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:21.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:21.904+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:22.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:22.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:22.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:22.872+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:23.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:23.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:23.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:23.836+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:24.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:24.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:24.850 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:24.844+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:25.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:25.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:25.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:25.864+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:26.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:26.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:26.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:26.904+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:27.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:27.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:27.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:27.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:28.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:28.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:28.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:28.924+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:29.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:29.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:29.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:29.952+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:30.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:30.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:30.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:30.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:31.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:31.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:31.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:31.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:32.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:32.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:32.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:32.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:33.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:33.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:33.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:33.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:34.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:34.460+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:35.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:35.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:35.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:35.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:35.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:35.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:36.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:36.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:36.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:36.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:37.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:37.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:37.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:37.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:38.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:38.524+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:39.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:39.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:39.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:39.556+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:40.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:40.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:40.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:40.540+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:41.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:41.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:41.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:41.528+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:42.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:42.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:42.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:42.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:43.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:43.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:43.490 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:43.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:44.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:44.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:44.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:44.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:45.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:45.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:45.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:45.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:46.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:46.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:46.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:46.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:47.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:47.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:47.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:47.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:48.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:48.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:48.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:48.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:49.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:49.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:49.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:49.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:50.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:50.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:50.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:50.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:51.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:51.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:51.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:51.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:52.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:52.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:52.454 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:52.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:53.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:53.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:53.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:53.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:54.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:54.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:54.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:54.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:54.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:54.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:55.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:55.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:55.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:55.948+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:56.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:56.460+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:56.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:56.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:57.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:57.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:57.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:57.892+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:58.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:58.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:58.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:58.876+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:59.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:20:59.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:20:59.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:20:59.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:00.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:00.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:00.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:00.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:01.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:01.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:01.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:01.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:02.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:02.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:02.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:02.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:03.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:03.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:03.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:03.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:04.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:04.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:04.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:04.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:05.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:05.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:06.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:05.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:06.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:06.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:07.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:07.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:07.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:07.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:07.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:07.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:08.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:08.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:08.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:08.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:09.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:09.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:09.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:09.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:10.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:10.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:10.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:10.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:11.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:11.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:11.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:11.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:12.454 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:12.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:13.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:13.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:13.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:13.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:14.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:13.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:14.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:14.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:14.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:14.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:15.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:15.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:15.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:15.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:16.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:16.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:16.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:16.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:17.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:17.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:17.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:17.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:18.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:18.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:18.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:18.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:19.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:19.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:19.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:19.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:20.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:20.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:20.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:20.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:21.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:21.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:21.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:21.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:22.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:22.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:22.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:22.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:23.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:23.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:23.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:23.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:24.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:24.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:24.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:24.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:25.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:25.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:25.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:25.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:26.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:26.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:26.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:26.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:27.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:27.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:27.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:27.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:28.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:28.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:28.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:28.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:29.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:29.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:29.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:29.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:30.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:30.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:30.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:30.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:31.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:31.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:31.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:31.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:32.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:32.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:32.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:32.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:33.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:33.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:33.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:33.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:34.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:34.515+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:34.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:34.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:35.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:35.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:35.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:35.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:36.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:36.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:36.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:36.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:37.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:37.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:37.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:37.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:38.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:38.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:38.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:38.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:39.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:39.587+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:39.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:39.847+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:40.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:40.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:40.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:40.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:41.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:41.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:41.878 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:41.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:42.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:42.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:42.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:42.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:43.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:43.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:43.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:43.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:44.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:44.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:44.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:44.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:45.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:45.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:45.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:45.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:46.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:46.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:46.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:46.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:47.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:47.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:47.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:47.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:48.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:48.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:48.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:48.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:49.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:49.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:49.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:49.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:50.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:50.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:50.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:50.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:51.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:51.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:51.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:51.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:52.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:52.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:52.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:52.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:53.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:53.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:53.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:53.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:54.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:54.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:54.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:54.867+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:55.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:55.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:55.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:55.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:56.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:56.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:56.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:56.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:57.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:57.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:57.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:57.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:58.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:58.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:58.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:58.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:59.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:21:59.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:21:59.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:21:59.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:00.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:00.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:00.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:00.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:01.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:01.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:01.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:01.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:02.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:02.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:02.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:02.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:03.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:03.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:03.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:03.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:04.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:04.634+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:04.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:04.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:05.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:05.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:05.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:05.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:06.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:06.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:06.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:06.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:07.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:07.666+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:07.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:07.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:08.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:08.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:08.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:08.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:09.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:09.630+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:09.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:09.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:10.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:10.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:10.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:10.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:11.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:11.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:11.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:11.854+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:12.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:12.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:12.859 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:12.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:13.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:13.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:13.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:13.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:14.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:14.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:14.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:14.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:15.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:15.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:15.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:15.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:16.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:16.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:16.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:16.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:17.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:17.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:17.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:17.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:18.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:18.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:19.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:18.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:19.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:19.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:20.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:20.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:20.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:20.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:21.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:21.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:21.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:21.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:22.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:22.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:22.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:22.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:23.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:23.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:23.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:23.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:24.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:24.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:24.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:24.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:25.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:25.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:25.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:25.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:26.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:26.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:26.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:26.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:27.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:27.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:27.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:27.922+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:28.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:28.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:28.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:28.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:29.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:29.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:29.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:29.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:30.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:30.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:30.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:30.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:31.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:31.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:31.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:31.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:32.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:32.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:32.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:32.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:33.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:33.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:33.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:33.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:34.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:34.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:34.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:34.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:35.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:35.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:35.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:35.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:36.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:36.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:36.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:36.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:37.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:37.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:37.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:37.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:38.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:38.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:38.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:38.922+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:39.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:39.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:39.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:39.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:40.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:40.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:40.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:40.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:41.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:41.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:41.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:41.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:42.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:42.174+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:42.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:42.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:43.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:43.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:43.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:43.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:44.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:44.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:44.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:44.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:45.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:45.086+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:45.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:45.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:46.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:46.090+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:46.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:46.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:47.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:47.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:47.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:47.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:48.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:48.114+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:49.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:49.022+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:49.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:49.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:50.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:50.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:50.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:50.090+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:51.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:51.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:51.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:51.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:51.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:51.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:52.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:52.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:52.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:52.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:53.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:53.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:54.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:53.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:54.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:54.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:55.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:55.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:55.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:55.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:56.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:56.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:56.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:56.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:57.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:57.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:57.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:57.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:58.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:58.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:58.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:58.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:59.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:22:59.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:22:59.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:22:59.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:00.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:00.117+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:00.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:00.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:01.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:01.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:01.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:01.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:02.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:02.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:02.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:02.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:03.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:03.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:03.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:03.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:04.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:04.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:04.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:04.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:05.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:05.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:05.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:05.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:06.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:06.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:06.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:06.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:07.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:07.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:07.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:07.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:08.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:08.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:08.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:08.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:09.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:09.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:09.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:09.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:10.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:10.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:10.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:10.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:11.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:11.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:11.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:11.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:12.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:12.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:12.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:12.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:13.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:13.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:13.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:13.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:14.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:14.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:14.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:14.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:15.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:15.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:15.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:15.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:16.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:16.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:16.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:16.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:17.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:17.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:17.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:17.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:18.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:18.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:18.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:18.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:19.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:19.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:19.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:19.177+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:20.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:20.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:20.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:20.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:21.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:21.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:21.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:21.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:22.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:22.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:22.254 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:22.245+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:23.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:23.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:23.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:23.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:24.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:24.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:24.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:24.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:25.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:25.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:25.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:25.201+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:26.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:26.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:26.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:26.221+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:27.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:27.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:27.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:27.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:28.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:28.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:28.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:28.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:29.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:29.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:29.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:29.205+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:30.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:30.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:30.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:30.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:31.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:31.153+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:31.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:31.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:32.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:32.205+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:32.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:32.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:33.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:33.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:33.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:33.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:34.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:34.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:34.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:34.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:35.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:35.161+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:35.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:35.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:36.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:36.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:36.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:36.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:37.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:37.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:37.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:37.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:38.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:38.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:38.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:38.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:39.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:39.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:39.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:39.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:40.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:40.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:40.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:40.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:41.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:41.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:41.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:41.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:42.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:42.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:42.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:42.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:43.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:43.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:43.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:43.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:44.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:44.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:44.350 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:44.345+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:45.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:45.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:45.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:45.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:46.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:46.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:46.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:46.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:47.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:47.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:47.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:47.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:48.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:48.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:48.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:48.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:49.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:49.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:49.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:49.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:50.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:50.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:50.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:50.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:51.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:51.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:51.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:51.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:52.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:52.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:52.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:52.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:53.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:53.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:53.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:53.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:54.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:54.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:54.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:54.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:55.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:55.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:55.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:55.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:56.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:56.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:56.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:56.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:57.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:57.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:57.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:57.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:58.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:58.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:58.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:58.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:59.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:23:59.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:23:59.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:23:59.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:00.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:00.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:00.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:00.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:01.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:01.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:01.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:01.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:02.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:02.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:02.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:02.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:03.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:03.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:03.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:03.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:04.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:04.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:04.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:04.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:05.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:05.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:05.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:05.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:06.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:06.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:06.266 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:06.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:07.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:07.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:07.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:07.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:08.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:08.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:08.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:08.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:09.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:09.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:09.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:09.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:10.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:10.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:10.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:10.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:11.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:11.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:11.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:11.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:12.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:12.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:12.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:12.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:13.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:13.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:13.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:13.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:14.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:14.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:14.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:14.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:15.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:15.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:15.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:15.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:16.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:16.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:16.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:16.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:17.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:17.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:17.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:17.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:18.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:18.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:18.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:18.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:19.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:19.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:19.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:19.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:20.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:20.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:20.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:20.304+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:21.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:21.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:21.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:21.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:22.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:22.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:22.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:22.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:23.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:23.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:23.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:23.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:24.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:24.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:24.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:24.320+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:25.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:25.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:25.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:25.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:26.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:26.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:26.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:26.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:27.289 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:27.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:27.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:27.312+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:28.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:28.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:28.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:28.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:29.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:29.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:29.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:29.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:30.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:30.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:30.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:30.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:31.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:31.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:31.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:31.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:32.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:32.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:32.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:32.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:33.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:33.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:33.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:33.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:34.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:34.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:34.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:34.304+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:35.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:35.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:35.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:35.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:36.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:36.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:36.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:36.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:37.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:37.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:37.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:37.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:38.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:38.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:38.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:38.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:39.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:39.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:39.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:39.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:40.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:40.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:40.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:40.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:41.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:41.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:41.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:41.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:42.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:42.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:42.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:42.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:43.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:43.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:43.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:43.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:44.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:44.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:44.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:44.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:45.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:45.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:45.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:45.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:46.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:46.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:46.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:46.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:47.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:47.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:47.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:47.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:48.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:48.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:48.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:48.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:49.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:49.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:49.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:49.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:50.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:50.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:50.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:50.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:51.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:51.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:51.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:51.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:52.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:52.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:52.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:52.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:53.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:53.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:53.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:53.495+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:54.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:54.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:54.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:54.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:55.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:55.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:55.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:55.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:56.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:56.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:56.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:56.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:57.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:57.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:57.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:57.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:58.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:58.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:58.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:58.495+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:59.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:24:59.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:24:59.539 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:24:59.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:00.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:00.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:00.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:00.547+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:01.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:01.255+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:01.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:01.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:02.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:02.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:02.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:02.571+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:03.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:03.275+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:03.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:03.543+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:04.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:04.303+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:04.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:04.563+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:05.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:05.303+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:05.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:05.603+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:06.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:06.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:06.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:06.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:07.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:07.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:07.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:07.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:08.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:08.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:08.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:08.579+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:09.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:09.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:09.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:09.551+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:10.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:10.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:10.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:10.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:11.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:11.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:11.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:11.499+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:12.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:12.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:12.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:12.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:13.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:13.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:13.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:13.535+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:14.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:14.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:14.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:14.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:15.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:15.331+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:15.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:15.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:16.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:16.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:16.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:16.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:17.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:17.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:17.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:17.515+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:18.300 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:18.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:18.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:18.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:19.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:19.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:19.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:19.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:20.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:20.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:20.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:20.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:21.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:21.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:21.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:21.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:22.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:22.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:22.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:22.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:23.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:23.251+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:23.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:23.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:24.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:24.299+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:24.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:24.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:25.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:25.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:25.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:25.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:26.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:26.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:26.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:26.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:27.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:27.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:27.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:27.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:28.201 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:28.195+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:28.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:28.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:29.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:29.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:29.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:29.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:30.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:30.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:30.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:30.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:31.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:31.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:31.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:31.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:32.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:32.115+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:32.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:32.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:33.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:33.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:33.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:33.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:34.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:34.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:34.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:34.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:35.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:35.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:35.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:35.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:36.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:36.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:36.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:36.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:37.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:37.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:37.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:37.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:38.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:38.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:38.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:38.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:39.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:39.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:39.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:39.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:40.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:40.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:40.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:40.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:41.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:41.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:41.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:41.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:42.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:42.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:42.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:42.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:43.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:43.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:43.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:43.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:44.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:44.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:44.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:44.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:44.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:44.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:45.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:45.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:45.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:45.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:46.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:46.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:46.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:46.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:47.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:47.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:47.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:47.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:48.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:48.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:48.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:48.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:49.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:49.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:49.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:49.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:50.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:50.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:51.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:51.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:51.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:51.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:51.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:51.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:52.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:52.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:52.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:52.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:53.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:53.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:53.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:53.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:54.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:54.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:54.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:54.951+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:55.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:55.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:55.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:55.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:56.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:56.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:56.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:56.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:57.291 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:57.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:58.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:58.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:58.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:58.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:58.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:25:58.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:25:59.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:25:59.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:00.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:00.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:00.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:00.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:01.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:01.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:01.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:01.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:02.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:02.038+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:02.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:02.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:03.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:02.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:03.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:03.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:03.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:03.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:04.279 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:04.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:04.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:04.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:05.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:05.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:05.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:05.986+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:06.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:06.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:06.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:06.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:07.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:07.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:07.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:07.918+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:08.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:08.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:08.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:08.938+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:09.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:09.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:09.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:09.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:10.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:10.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:10.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:10.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:11.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:11.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:11.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:11.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:12.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:12.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:12.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:12.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:13.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:13.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:13.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:13.978+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:14.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:14.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:15.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:15.026+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:15.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:15.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:16.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:15.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:16.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:16.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:17.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:17.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:17.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:17.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:18.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:18.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:18.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:18.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:19.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:19.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:19.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:19.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:20.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:19.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:20.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:20.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:20.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:20.986+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:21.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:21.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:21.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:21.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:22.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:22.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:22.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:22.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:23.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:23.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:23.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:23.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:24.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:24.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:24.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:24.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:25.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:25.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:25.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:25.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:26.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:26.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:26.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:26.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:27.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:27.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:27.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:27.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:28.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:28.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:28.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:28.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:29.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:29.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:29.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:29.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:30.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:30.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:30.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:30.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:31.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:31.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:31.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:31.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:32.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:32.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:32.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:32.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:33.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:33.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:33.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:33.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:34.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:34.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:34.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:34.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:35.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:35.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:35.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:35.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:36.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:36.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:36.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:36.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:37.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:37.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:37.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:37.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:38.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:38.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:38.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:38.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:39.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:39.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:39.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:39.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:40.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:40.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:40.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:40.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:41.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:41.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:41.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:41.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:42.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:42.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:42.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:42.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:43.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:43.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:43.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:43.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:44.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:44.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:44.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:44.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:45.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:45.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:45.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:45.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:46.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:46.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:46.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:46.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:47.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:47.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:47.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:47.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:48.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:48.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:48.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:48.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:49.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:49.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:49.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:49.898+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:50.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:50.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:50.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:50.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:51.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:51.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:51.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:51.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:52.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:52.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:52.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:52.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:53.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:53.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:53.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:53.962+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:54.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:54.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:54.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:54.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:55.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:55.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:55.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:55.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:56.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:56.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:56.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:56.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:57.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:57.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:57.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:57.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:58.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:58.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:58.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:58.990+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:59.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:26:59.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:26:59.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:26:59.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:00.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:00.114+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:00.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:00.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:01.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:01.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:01.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:01.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:02.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:02.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:02.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:02.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:03.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:03.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:03.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:03.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:04.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:04.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:04.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:04.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:05.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:05.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:05.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:05.986+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:06.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:06.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:06.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:06.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:07.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:07.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:07.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:07.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:08.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:08.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:08.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:08.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:09.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:09.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:09.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:09.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:10.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:10.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:11.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:10.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:11.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:11.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:12.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:12.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:12.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:12.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:13.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:13.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:13.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:13.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:13.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:13.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:14.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:14.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:15.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:15.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:15.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:15.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:16.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:16.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:16.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:16.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:17.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:17.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:17.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:17.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:18.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:18.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:18.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:18.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:19.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:19.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:19.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:19.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:20.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:20.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:20.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:20.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:21.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:21.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:21.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:21.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:22.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:22.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:22.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:22.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:23.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:23.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:23.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:23.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:24.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:24.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:24.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:24.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:25.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:25.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:25.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:25.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:26.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:26.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:26.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:26.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:27.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:27.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:27.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:27.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:28.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:28.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:28.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:28.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:29.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:29.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:29.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:29.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:30.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:30.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:30.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:30.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:31.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:31.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:31.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:31.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:32.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:32.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:32.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:32.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:33.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:33.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:33.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:33.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:34.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:34.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:34.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:34.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:35.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:35.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:35.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:35.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:36.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:36.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:36.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:36.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:37.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:37.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:37.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:37.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:38.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:38.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:38.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:38.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:39.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:39.045+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:39.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:39.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:40.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:40.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:40.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:40.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:41.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:41.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:41.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:41.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:42.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:42.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:42.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:42.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:43.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:43.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:43.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:43.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:44.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:44.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:44.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:44.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:45.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:45.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:45.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:45.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:46.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:46.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:46.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:46.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:47.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:47.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:47.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:47.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:48.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:48.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:48.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:48.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:49.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:49.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:49.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:49.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:50.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:50.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:50.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:50.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:51.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:51.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:51.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:51.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:52.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:52.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:52.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:52.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:53.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:53.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:53.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:53.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:53.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:53.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:54.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:54.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:55.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:55.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:55.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:55.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:56.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:55.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:56.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:56.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:57.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:57.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:57.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:57.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:58.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:58.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:58.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:58.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:59.047 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:27:59.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:27:59.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:27:59.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:00.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:00.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:00.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:00.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:01.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:01.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:01.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:01.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:02.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:02.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:02.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:02.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:02.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:02.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:03.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:03.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:03.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:03.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:04.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:04.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:05.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:04.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:05.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:05.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:05.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:05.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:06.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:06.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:07.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:07.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:07.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:07.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:08.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:08.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:08.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:08.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:09.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:09.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:09.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:09.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:10.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:10.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:10.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:10.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:11.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:11.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:11.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:11.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:12.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:12.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:12.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:12.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:13.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:13.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:13.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:13.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:14.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:14.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:14.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:14.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:15.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:15.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:15.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:15.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:16.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:16.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:16.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:16.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:17.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:17.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:17.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:17.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:18.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:18.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:18.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:18.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:19.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:19.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:19.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:19.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:20.192 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:20.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:20.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:20.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:21.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:21.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:21.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:21.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:22.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:22.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:22.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:22.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:23.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:23.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:23.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:23.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:24.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:24.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:24.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:24.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:25.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:25.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:25.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:25.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:26.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:26.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:26.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:26.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:27.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:27.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:27.325 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:27.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:28.236 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:28.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:28.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:28.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:29.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:29.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:29.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:29.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:30.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:30.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:30.409 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:30.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:31.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:31.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:31.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:31.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:32.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:32.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:32.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:32.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:33.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:33.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:33.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:33.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:34.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:34.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:34.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:34.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:35.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:35.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:35.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:35.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:36.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:36.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:36.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:36.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:37.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:37.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:37.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:37.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:38.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:38.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:38.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:38.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:39.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:39.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:39.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:39.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:40.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:40.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:40.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:40.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:41.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:41.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:41.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:41.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:42.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:42.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:42.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:42.460+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:43.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:43.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:43.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:43.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:44.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:44.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:44.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:44.460+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:45.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:45.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:45.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:45.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:46.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:46.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:46.443 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:46.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:47.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:47.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:47.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:47.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:48.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:48.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:48.355 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:48.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:49.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:49.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:49.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:49.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:50.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:50.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:50.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:50.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:51.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:51.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:51.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:51.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:52.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:52.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:52.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:52.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:53.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:53.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:53.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:53.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:54.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:54.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:54.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:54.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:55.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:55.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:55.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:55.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:56.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:56.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:56.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:56.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:57.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:57.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:57.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:57.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:58.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:58.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:58.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:58.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:59.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:28:59.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:28:59.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:28:59.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:00.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:00.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:00.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:00.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:01.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:01.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:01.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:01.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:02.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:02.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:02.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:02.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:03.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:03.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:03.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:03.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:04.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:04.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:04.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:04.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:05.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:05.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:05.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:05.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:06.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:06.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:06.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:06.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:07.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:07.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:07.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:07.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:08.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:08.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:08.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:08.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:09.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:09.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:09.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:09.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:10.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:10.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:10.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:10.356+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:11.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:11.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:11.388 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:11.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:12.149 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:12.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:12.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:12.423+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:13.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:13.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:13.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:13.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:14.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:14.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:14.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:14.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:15.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:15.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:15.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:15.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:16.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:16.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:16.508 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:16.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:17.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:17.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:17.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:17.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:18.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:18.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:18.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:18.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:19.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:19.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:19.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:19.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:20.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:20.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:20.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:20.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:21.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:21.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:21.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:21.383+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:22.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:22.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:22.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:22.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:23.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:23.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:23.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:23.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:24.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:24.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:24.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:24.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:25.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:25.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:25.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:25.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:26.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:26.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:26.359 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:26.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:27.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:27.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:27.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:27.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:28.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:28.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:28.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:28.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:29.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:29.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:29.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:29.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:30.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:30.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:30.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:30.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:31.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:31.095+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:31.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:31.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:32.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:32.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:32.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:32.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:33.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:33.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:33.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:33.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:34.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:34.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:34.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:34.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:35.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:35.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:35.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:35.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:36.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:36.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:36.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:36.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:37.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:37.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:37.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:37.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:38.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:38.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:38.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:38.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:39.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:39.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:39.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:39.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:40.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:40.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:40.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:40.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:41.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:41.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:41.395 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:41.387+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:42.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:42.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:42.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:42.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:43.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:43.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:43.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:43.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:44.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:44.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:44.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:44.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:45.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:45.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:45.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:45.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:46.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:46.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:46.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:46.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:47.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:47.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:47.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:47.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:48.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:48.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:48.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:48.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:49.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:49.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:49.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:49.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:50.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:50.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:50.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:50.463+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:51.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:51.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:51.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:51.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:52.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:52.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:52.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:52.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:53.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:53.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:53.371 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:53.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:54.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:54.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:54.399 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:54.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:55.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:55.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:55.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:55.435+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:56.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:56.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:56.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:56.463+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:57.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:57.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:57.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:57.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:58.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:58.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:58.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:58.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:59.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:29:59.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:29:59.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:29:59.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:00.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:00.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:00.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:00.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:01.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:01.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:01.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:01.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:02.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:02.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:02.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:02.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:03.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:03.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:03.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:03.595+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:04.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:04.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:04.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:04.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:05.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:05.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:05.532 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:05.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:06.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:06.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:06.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:06.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:07.120 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:07.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:07.510 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:07.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:08.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:08.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:08.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:08.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:09.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:09.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:09.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:09.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:10.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:10.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:10.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:10.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:11.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:11.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:11.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:11.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:12.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:12.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:12.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:12.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:13.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:13.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:13.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:13.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:14.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:14.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:14.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:14.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:15.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:15.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:15.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:15.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:16.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:16.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:16.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:16.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:17.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:17.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:17.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:17.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:18.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:18.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:18.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:18.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:18.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:18.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:19.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:19.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:20.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:20.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:20.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:20.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:20.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:20.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:21.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:21.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:21.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:21.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:22.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:22.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:22.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:22.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:23.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:23.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:23.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:23.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:24.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:24.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:24.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:24.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:25.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:25.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:25.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:25.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:26.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:26.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:26.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:26.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:27.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:27.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:27.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:27.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:28.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:28.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:28.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:28.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:29.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:29.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:29.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:29.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:30.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:30.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:30.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:30.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:31.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:31.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:31.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:31.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:32.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:32.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:32.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:32.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:33.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:33.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:33.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:33.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:34.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:34.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:34.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:34.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:35.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:35.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:35.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:35.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:36.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:36.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:36.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:36.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:37.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:37.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:37.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:37.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:38.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:38.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:38.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:38.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:39.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:39.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:39.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:39.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:40.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:40.670+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:40.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:40.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:41.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:41.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:41.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:41.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:42.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:42.670+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:42.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:42.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:43.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:43.634+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:43.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:43.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:44.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:44.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:44.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:44.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:45.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:45.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:45.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:45.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:46.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:46.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:46.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:46.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:47.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:47.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:48.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:48.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:48.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:48.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:49.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:49.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:49.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:49.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:50.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:50.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:50.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:50.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:51.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:51.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:51.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:51.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:52.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:52.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:52.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:52.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:53.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:53.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:53.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:53.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:53.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:53.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:54.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:54.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:55.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:54.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:55.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:55.682+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:56.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:56.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:56.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:56.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:57.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:57.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:57.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:57.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:58.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:58.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:58.750 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:58.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:59.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:30:59.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:30:59.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:30:59.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:00.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:00.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:00.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:00.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:00.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:00.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:01.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:01.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:01.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:01.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:02.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:02.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:02.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:02.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:03.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:03.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:03.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:03.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:04.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:04.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:05.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:05.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:05.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:05.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:06.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:06.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:06.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:06.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:07.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:07.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:07.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:07.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:08.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:08.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:08.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:08.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:09.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:09.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:09.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:09.786+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:10.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:10.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:10.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:10.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:10.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:10.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:11.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:11.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:12.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:12.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:12.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:12.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:13.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:13.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:13.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:13.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:14.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:13.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:14.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:14.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:15.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:14.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:15.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:15.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:15.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:15.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:16.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:16.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:16.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:16.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:17.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:17.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:18.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:18.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:18.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:18.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:19.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:19.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:19.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:19.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:20.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:20.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:20.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:20.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:21.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:21.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:21.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:21.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:22.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:21.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:22.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:22.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:22.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:22.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:23.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:23.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:23.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:23.961+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:24.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:24.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:24.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:24.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:25.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:25.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:26.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:26.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:26.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:26.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:27.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:27.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:27.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:27.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:28.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:28.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:28.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:28.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:29.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:29.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:29.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:29.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:30.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:30.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:30.939 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:30.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:31.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:31.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:31.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:31.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:32.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:32.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:32.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:32.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:33.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:33.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:33.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:33.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:34.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:34.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:34.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:34.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:35.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:35.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:35.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:35.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:36.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:36.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:36.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:36.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:37.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:37.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:37.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:37.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:38.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:38.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:39.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:39.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:39.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:39.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:39.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:39.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:40.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:40.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:40.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:40.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:41.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:41.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:41.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:41.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:42.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:42.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:42.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:42.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:43.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:43.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:43.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:43.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:44.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:44.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:44.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:44.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:45.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:45.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:45.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:45.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:46.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:46.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:46.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:46.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:47.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:47.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:47.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:47.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:48.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:48.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:48.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:48.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:49.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:49.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:49.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:49.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:50.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:50.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:50.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:50.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:51.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:51.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:51.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:51.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:52.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:52.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:52.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:52.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:53.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:53.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:53.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:53.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:54.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:54.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:54.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:54.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:55.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:55.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:55.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:55.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:56.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:56.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:56.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:56.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:57.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:57.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:57.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:57.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:58.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:58.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:58.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:58.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:59.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:31:59.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:31:59.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:31:59.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:00.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:00.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:00.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:00.961+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:01.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:01.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:01.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:01.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:02.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:02.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:02.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:02.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:03.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:03.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:03.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:03.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:04.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:04.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:04.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:04.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:05.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:05.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:06.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:06.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:06.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:06.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:07.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:06.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:07.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:07.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:08.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:08.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:08.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:08.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:09.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:09.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:09.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:09.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:10.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:10.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:10.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:10.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:11.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:11.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:11.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:11.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:12.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:12.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:12.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:12.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:13.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:13.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:13.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:13.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:14.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:14.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:14.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:14.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:15.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:15.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:15.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:15.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:16.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:16.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:16.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:16.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:17.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:17.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:17.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:17.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:18.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:18.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:18.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:18.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:19.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:19.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:19.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:19.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:20.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:20.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:20.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:20.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:21.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:21.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:21.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:21.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:22.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:22.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:22.204 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:22.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:23.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:23.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:23.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:23.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:24.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:24.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:24.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:24.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:25.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:25.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:25.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:25.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:26.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:26.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:26.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:26.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:27.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:27.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:27.294 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:27.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:28.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:28.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:28.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:28.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:29.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:29.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:29.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:29.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:30.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:30.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:30.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:30.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:31.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:31.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:31.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:31.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:32.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:32.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:32.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:32.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:33.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:33.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:33.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:33.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:34.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:34.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:34.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:34.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:35.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:35.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:35.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:35.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:36.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:36.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:36.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:36.352+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:37.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:37.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:37.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:37.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:38.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:38.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:38.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:38.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:39.119 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:39.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:39.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:39.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:40.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:40.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:40.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:40.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:41.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:41.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:41.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:41.432+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:42.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:42.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:42.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:42.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:43.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:43.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:43.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:43.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:44.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:44.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:44.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:44.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:45.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:45.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:45.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:45.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:46.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:46.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:46.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:46.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:47.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:47.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:47.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:47.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:48.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:48.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:48.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:48.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:49.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:49.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:49.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:49.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:50.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:50.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:50.201 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:50.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:51.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:51.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:51.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:51.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:52.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:52.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:52.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:52.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:53.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:53.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:53.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:53.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:54.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:54.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:54.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:54.292+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:55.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:55.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:55.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:55.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:56.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:56.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:56.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:56.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:57.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:57.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:57.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:57.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:58.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:58.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:58.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:58.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:59.095 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:32:59.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:32:59.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:32:59.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:00.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:00.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:00.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:00.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:01.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:01.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:01.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:01.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:02.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:02.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:02.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:02.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:03.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:03.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:03.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:03.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:04.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:04.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:04.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:04.428+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:05.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:05.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:05.474 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:05.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:06.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:06.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:06.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:06.508+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:07.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:07.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:07.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:07.552+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:08.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:08.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:08.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:08.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:09.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:09.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:09.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:09.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:10.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:10.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:10.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:10.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:11.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:11.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:11.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:11.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:12.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:12.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:12.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:12.536+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:13.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:13.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:13.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:13.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:14.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:14.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:14.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:14.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:15.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:15.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:15.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:15.519+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:16.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:16.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:16.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:16.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:17.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:17.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:17.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:17.479+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:18.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:17.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:18.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:18.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:18.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:18.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:19.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:19.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:19.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:19.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:20.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:20.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:20.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:20.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:21.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:21.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:21.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:21.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:22.443 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:22.439+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:22.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:22.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:23.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:23.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:23.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:23.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:24.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:24.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:25.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:25.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:25.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:25.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:25.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:25.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:26.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:26.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:26.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:26.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:27.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:27.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:27.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:27.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:28.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:28.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:28.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:28.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:29.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:29.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:29.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:29.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:30.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:30.383+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:30.972 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:30.967+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:31.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:31.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:31.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:31.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:32.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:32.391+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:32.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:32.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:33.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:33.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:33.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:33.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:34.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:34.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:34.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:34.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:35.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:35.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:35.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:35.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:36.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:36.383+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:36.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:36.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:37.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:37.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:37.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:37.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:38.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:38.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:38.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:38.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:39.413 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:39.407+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:39.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:39.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:40.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:40.391+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:41.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:40.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:41.431 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:41.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:42.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:42.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:42.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:42.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:43.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:43.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:43.479 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:43.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:43.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:43.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:44.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:44.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:45.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:45.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:45.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:45.407+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:45.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:45.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:46.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:46.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:47.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:47.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:47.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:47.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:48.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:48.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:48.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:48.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:49.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:49.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:49.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:49.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:50.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:50.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:50.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:50.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:51.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:51.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:51.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:51.431+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:52.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:52.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:52.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:52.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:53.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:53.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:53.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:53.439+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:54.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:54.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:54.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:54.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:55.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:54.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:55.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:55.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:56.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:56.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:56.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:56.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:56.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:56.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:57.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:57.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:58.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:57.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:58.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:58.387+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:59.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:33:59.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:33:59.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:33:59.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:00.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:00.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:00.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:00.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:01.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:01.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:01.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:01.407+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:02.116 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:02.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:02.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:02.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:03.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:03.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:03.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:03.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:04.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:04.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:04.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:04.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:05.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:05.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:05.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:05.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:06.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:06.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:06.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:06.439+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:07.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:07.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:07.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:07.435+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:08.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:08.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:08.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:08.451+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:09.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:09.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:09.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:09.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:10.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:10.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:10.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:10.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:11.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:11.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:11.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:11.406+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:12.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:12.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:12.379 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:12.374+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:13.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:13.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:13.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:13.386+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:14.112 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:14.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:14.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:14.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:15.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:15.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:15.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:15.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:16.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:16.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:16.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:16.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:17.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:17.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:17.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:17.446+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:18.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:18.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:18.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:18.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:19.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:19.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:19.474 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:19.466+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:20.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:20.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:20.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:20.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:21.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:21.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:21.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:21.514+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:22.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:22.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:22.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:22.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:23.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:23.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:23.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:23.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:24.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:24.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:24.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:24.494+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:25.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:25.126+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:25.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:25.494+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:26.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:26.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:26.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:26.510+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:27.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:27.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:27.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:27.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:28.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:28.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:28.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:28.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:29.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:29.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:29.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:29.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:30.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:30.162+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:30.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:30.490+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:31.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:31.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:31.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:31.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:32.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:32.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:32.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:32.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:33.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:33.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:33.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:33.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:34.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:34.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:34.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:34.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:35.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:35.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:35.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:35.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:36.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:36.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:36.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:36.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:37.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:37.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:37.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:37.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:38.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:38.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:38.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:38.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:39.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:39.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:39.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:39.690+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:40.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:40.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:40.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:40.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:41.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:41.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:41.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:41.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:42.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:42.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:42.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:42.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:43.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:43.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:43.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:43.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:44.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:44.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:44.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:44.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:45.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:45.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:45.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:45.726+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:46.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:46.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:46.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:46.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:47.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:47.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:47.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:47.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:48.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:48.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:48.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:48.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:49.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:49.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:49.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:49.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:50.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:50.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:50.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:50.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:51.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:51.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:51.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:51.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:52.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:52.174+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:52.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:52.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:53.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:53.158+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:53.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:53.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:54.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:54.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:54.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:54.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:55.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:55.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:55.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:55.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:56.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:56.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:56.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:56.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:57.101 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:57.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:57.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:57.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:58.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:58.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:58.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:58.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:59.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:34:59.110+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:34:59.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:34:59.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:00.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:00.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:00.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:00.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:01.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:01.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:01.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:01.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:02.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:02.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:02.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:02.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:03.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:03.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:03.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:03.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:04.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:04.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:04.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:04.702+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:05.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:05.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:05.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:05.674+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:06.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:06.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:06.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:06.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:07.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:07.182+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:07.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:07.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:08.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:08.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:08.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:08.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:09.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:09.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:09.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:09.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:10.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:10.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:10.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:10.581+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:11.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:11.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:11.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:11.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:12.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:12.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:12.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:12.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:13.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:13.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:13.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:13.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:14.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:14.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:14.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:14.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:15.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:15.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:15.616 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:15.609+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:16.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:16.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:16.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:16.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:17.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:17.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:17.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:17.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:18.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:18.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:18.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:18.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:19.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:19.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:19.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:19.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:20.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:20.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:20.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:20.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:21.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:21.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:21.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:21.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:22.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:22.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:22.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:22.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:23.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:23.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:23.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:23.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:24.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:24.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:24.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:24.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:25.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:25.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:25.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:25.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:26.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:26.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:26.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:26.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:27.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:27.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:27.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:27.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:28.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:28.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:28.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:28.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:29.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:29.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:29.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:29.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:30.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:30.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:30.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:30.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:31.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:31.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:31.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:31.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:32.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:32.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:32.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:32.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:33.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:33.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:33.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:33.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:34.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:34.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:34.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:34.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:35.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:35.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:35.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:35.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:36.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:36.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:36.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:36.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:37.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:37.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:37.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:37.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:38.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:38.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:38.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:38.645+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:39.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:39.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:39.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:39.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:40.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:40.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:40.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:40.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:41.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:41.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:41.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:41.581+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:42.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:42.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:42.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:42.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:43.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:43.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:43.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:43.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:44.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:44.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:44.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:44.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:45.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:45.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:45.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:45.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:46.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:46.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:46.571 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:46.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:47.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:47.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:47.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:47.565+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:48.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:48.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:48.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:48.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:49.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:49.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:49.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:49.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:50.588 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:50.581+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:50.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:50.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:51.567 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:51.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:51.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:51.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:52.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:52.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:52.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:52.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:53.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:53.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:53.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:53.613+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:54.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:54.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:54.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:54.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:55.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:55.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:55.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:55.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:56.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:56.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:56.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:56.581+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:57.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:57.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:57.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:57.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:58.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:58.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:58.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:58.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:59.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:35:59.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:35:59.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:35:59.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:00.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:00.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:00.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:00.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:01.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:01.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:01.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:01.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:02.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:02.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:02.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:02.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:03.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:03.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:03.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:03.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:04.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:04.324+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:04.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:04.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:05.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:05.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:05.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:05.616+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:06.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:06.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:06.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:06.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:07.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:07.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:07.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:07.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:08.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:08.344+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:08.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:08.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:09.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:09.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:09.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:09.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:10.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:10.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:10.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:10.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:11.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:11.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:11.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:11.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:12.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:12.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:12.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:12.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:13.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:13.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:13.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:13.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:14.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:14.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:14.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:14.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:15.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:15.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:15.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:15.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:16.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:16.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:16.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:16.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:17.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:17.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:17.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:17.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:18.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:18.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:18.738 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:18.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:19.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:19.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:19.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:19.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:20.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:20.304+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:20.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:20.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:21.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:21.320+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:21.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:21.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:22.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:22.304+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:22.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:22.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:23.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:23.336+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:23.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:23.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:24.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:24.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:24.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:24.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:25.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:25.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:25.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:25.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:26.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:26.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:26.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:26.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:27.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:27.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:27.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:27.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:28.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:28.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:28.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:28.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:29.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:29.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:29.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:29.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:30.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:30.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:30.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:30.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:31.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:31.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:31.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:31.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:32.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:32.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:32.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:32.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:33.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:33.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:33.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:33.936+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:34.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:34.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:34.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:34.940+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:35.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:35.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:35.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:35.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:36.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:36.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:37.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:37.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:37.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:37.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:37.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:37.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:38.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:38.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:39.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:39.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:39.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:39.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:40.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:40.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:40.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:40.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:41.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:41.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:41.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:41.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:42.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:42.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:42.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:42.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:43.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:43.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:43.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:43.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:44.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:44.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:44.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:44.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:45.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:45.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:45.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:45.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:46.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:46.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:46.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:46.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:47.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:47.092+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:47.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:47.312+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:48.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:48.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:48.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:48.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:49.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:49.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:49.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:49.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:50.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:50.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:50.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:50.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:51.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:51.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:51.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:51.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:52.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:52.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:52.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:52.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:53.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:53.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:53.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:53.344+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:54.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:54.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:54.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:54.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:55.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:55.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:55.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:55.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:56.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:56.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:56.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:56.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:57.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:57.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:57.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:57.344+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:58.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:58.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:58.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:58.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:59.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:36:59.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:36:59.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:36:59.340+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:00.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:00.255+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:00.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:00.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:01.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:01.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:01.348 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:01.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:02.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:02.195+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:02.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:02.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:03.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:03.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:03.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:03.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:04.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:04.227+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:04.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:04.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:05.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:05.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:05.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:05.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:06.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:06.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:06.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:06.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:07.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:07.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:07.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:07.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:08.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:08.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:08.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:08.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:09.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:09.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:09.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:09.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:10.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:10.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:10.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:10.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:11.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:11.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:11.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:11.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:12.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:12.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:12.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:12.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:13.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:13.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:13.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:13.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:14.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:14.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:14.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:14.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:15.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:15.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:15.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:15.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:16.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:16.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:16.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:16.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:17.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:17.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:17.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:17.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:18.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:18.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:18.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:18.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:19.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:19.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:19.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:19.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:20.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:20.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:20.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:20.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:21.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:21.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:21.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:21.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:22.214 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:22.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:22.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:22.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:23.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:23.259+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:23.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:23.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:24.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:24.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:24.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:24.335+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:25.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:25.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:25.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:25.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:26.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:26.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:26.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:26.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:27.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:27.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:27.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:27.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:28.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:28.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:28.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:28.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:29.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:29.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:29.347 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:29.343+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:30.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:30.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:30.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:30.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:31.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:31.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:31.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:31.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:32.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:32.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:32.374 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:32.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:33.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:33.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:33.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:33.391+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:34.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:34.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:34.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:34.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:35.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:35.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:35.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:35.391+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:36.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:36.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:36.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:36.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:37.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:37.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:37.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:37.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:38.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:38.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:38.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:38.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:39.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:39.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:39.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:39.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:40.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:40.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:40.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:40.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:41.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:41.303+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:41.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:41.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:42.356 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:42.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:42.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:42.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:43.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:43.343+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:43.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:43.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:44.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:44.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:44.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:44.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:45.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:45.367+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:45.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:45.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:46.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:46.343+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:46.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:46.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:47.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:47.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:47.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:47.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:48.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:48.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:48.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:48.539+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:49.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:49.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:49.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:49.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:50.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:50.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:50.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:50.495+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:51.431 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:51.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:51.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:51.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:52.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:52.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:52.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:52.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:53.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:53.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:53.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:53.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:54.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:54.375+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:54.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:54.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:55.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:55.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:55.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:55.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:56.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:56.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:56.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:56.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:57.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:57.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:57.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:57.582+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:58.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:58.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:58.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:58.594+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:59.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:37:59.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:37:59.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:37:59.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:00.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:00.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:00.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:00.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:01.358 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:01.350+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:01.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:01.710+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:02.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:02.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:02.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:02.682+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:03.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:03.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:03.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:03.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:04.327 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:04.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:04.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:04.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:05.368 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:05.362+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:05.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:05.654+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:06.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:06.382+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:06.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:06.674+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:07.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:07.402+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:07.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:07.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:08.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:08.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:08.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:08.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:09.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:09.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:09.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:09.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:10.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:10.398+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:10.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:10.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:11.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:11.422+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:11.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:11.738+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:12.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:12.442+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:12.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:12.766+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:13.460 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:13.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:13.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:13.742+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:14.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:14.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:14.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:14.738+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:15.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:15.446+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:15.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:15.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:16.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:16.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:16.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:16.734+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:17.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:17.382+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:17.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:17.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:18.402 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:18.394+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:18.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:18.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:19.438 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:19.430+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:19.775 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:19.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:20.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:20.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:20.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:20.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:21.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:21.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:21.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:21.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:22.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:22.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:22.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:22.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:23.508 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:23.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:23.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:23.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:24.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:24.510+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:24.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:24.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:25.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:25.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:25.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:25.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:26.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:26.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:26.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:26.726+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:27.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:27.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:27.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:27.766+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:28.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:28.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:28.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:28.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:29.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:29.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:29.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:29.690+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:30.542 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:30.534+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:30.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:30.738+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:31.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:31.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:31.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:31.786+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:32.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:32.534+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:32.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:32.778+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:33.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:33.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:33.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:33.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:34.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:34.534+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:34.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:34.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:35.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:35.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:35.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:35.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:36.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:36.494+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:36.800 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:36.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:37.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:37.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:37.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:37.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:38.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:38.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:38.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:38.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:39.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:39.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:39.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:39.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:40.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:40.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:40.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:40.686+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:41.619 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:41.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:41.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:41.678+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:42.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:42.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:42.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:42.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:43.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:43.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:43.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:43.706+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:44.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:44.606+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:44.732 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:44.726+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:45.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:45.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:45.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:45.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:46.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:46.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:46.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:46.714+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:47.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:47.678+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:47.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:47.734+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:48.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:48.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:48.725 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:48.718+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:49.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:49.709+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:49.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:49.721+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:50.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:50.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:50.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:50.757+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:51.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:51.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:51.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:51.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:52.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:52.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:52.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:52.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:53.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:53.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:53.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:53.833+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:54.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:54.785+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:54.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:54.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:55.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:55.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:55.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:55.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:56.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:56.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:56.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:56.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:57.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:57.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:57.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:57.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:58.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:58.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:58.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:58.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:59.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:38:59.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:38:59.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:38:59.813+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:00.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:00.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:00.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:00.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:01.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:01.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:01.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:01.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:02.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:02.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:02.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:02.877+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:03.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:03.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:03.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:03.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:04.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:04.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:04.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:04.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:05.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:05.881+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:05.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:05.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:06.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:06.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:06.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:06.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:07.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:07.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:07.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:07.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:08.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:08.813+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:08.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:08.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:09.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:09.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:09.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:09.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:10.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:10.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:10.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:10.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:11.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:11.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:11.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:11.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:12.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:12.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:12.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:12.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:13.830 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:13.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:13.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:13.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:14.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:14.801+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:14.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:14.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:15.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:15.757+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:15.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:15.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:16.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:16.725+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:16.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:16.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:17.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:17.777+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:17.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:17.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:18.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:18.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:18.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:18.813+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:19.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:19.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:19.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:19.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:20.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:20.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:20.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:20.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:21.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:21.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:21.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:21.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:22.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:22.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:22.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:22.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:23.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:23.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:23.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:23.949+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:24.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:24.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:24.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:24.953+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:25.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:25.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:25.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:25.905+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:26.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:26.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:26.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:26.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:27.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:27.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:27.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:27.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:28.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:28.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:28.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:28.949+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:29.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:29.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:29.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:29.949+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:30.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:30.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:30.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:30.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:31.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:31.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:31.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:31.985+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:32.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:32.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:33.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:33.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:33.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:33.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:33.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:33.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:34.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:34.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:34.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:34.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:35.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:35.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:35.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:35.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:36.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:36.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:37.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:37.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:38.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:38.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:38.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:38.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:38.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:38.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:39.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:39.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:39.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:39.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:40.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:39.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:41.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:41.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:41.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:41.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:41.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:41.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:42.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:42.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:42.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:42.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:42.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:42.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:43.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:43.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:43.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:43.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:45.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:44.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:45.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:45.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:46.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:46.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:46.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:46.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:47.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:47.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:47.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:47.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:47.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:47.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:48.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:48.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:48.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:48.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:49.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:49.068+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:49.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:49.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:50.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:50.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:50.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:50.940+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:51.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:51.108+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:51.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:51.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:52.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:52.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:52.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:52.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:53.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:53.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:53.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:53.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:54.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:54.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:54.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:54.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:55.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:55.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:55.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:55.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:56.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:56.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:56.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:56.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:57.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:57.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:57.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:57.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:58.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:58.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:58.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:58.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:59.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:39:59.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:39:59.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:39:59.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:00.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:00.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:00.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:00.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:01.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:01.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:01.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:01.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:02.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:02.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:02.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:02.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:03.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:03.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:03.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:03.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:04.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:04.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:04.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:04.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:05.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:05.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:05.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:05.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:06.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:06.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:06.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:06.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:07.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:07.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:07.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:07.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:08.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:08.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:08.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:08.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:09.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:09.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:09.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:09.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:10.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:10.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:10.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:10.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:11.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:11.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:11.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:11.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:12.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:12.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:12.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:12.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:13.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:13.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:13.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:13.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:14.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:14.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:14.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:14.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:15.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:15.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:15.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:15.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:16.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:16.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:16.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:16.856+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:17.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:17.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:17.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:17.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:18.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:18.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:18.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:18.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:19.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:19.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:19.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:19.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:20.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:20.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:20.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:20.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:21.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:21.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:21.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:21.868+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:22.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:22.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:22.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:22.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:23.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:23.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:23.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:23.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:24.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:24.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:24.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:24.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:25.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:25.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:25.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:25.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:26.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:26.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:26.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:26.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:27.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:27.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:27.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:27.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:28.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:28.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:28.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:28.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:29.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:29.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:29.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:29.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:30.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:30.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:30.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:30.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:31.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:31.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:31.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:31.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:32.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:32.060+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:32.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:32.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:33.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:33.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:33.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:33.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:34.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:34.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:34.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:34.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:35.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:35.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:35.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:35.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:36.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:36.000+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:36.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:36.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:36.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:36.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:37.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:37.827+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:37.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:37.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:38.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:38.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:38.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:38.967+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:39.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:39.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:39.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:39.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:40.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:40.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:40.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:40.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:41.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:41.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:41.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:41.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:42.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:42.827+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:43.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:43.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:43.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:43.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:43.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:43.979+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:44.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:44.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:45.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:45.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:45.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:45.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:46.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:45.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:46.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:46.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:47.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:47.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:47.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:47.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:48.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:48.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:48.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:48.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:49.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:49.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:49.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:49.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:50.030 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:50.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:50.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:50.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:51.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:51.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:51.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:51.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:52.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:52.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:52.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:52.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:53.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:53.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:53.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:53.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:53.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:53.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:54.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:54.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:54.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:54.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:55.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:55.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:55.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:55.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:56.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:56.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:56.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:56.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:57.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:57.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:57.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:57.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:58.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:58.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:58.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:58.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:59.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:40:59.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:40:59.887 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:40:59.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:00.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:00.599+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:00.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:00.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:01.644 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:01.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:01.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:01.855+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:02.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:02.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:02.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:02.879+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:03.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:03.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:03.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:03.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:04.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:04.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:04.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:04.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:05.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:05.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:05.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:05.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:06.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:06.567+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:06.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:06.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:07.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:07.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:07.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:07.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:08.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:08.579+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:08.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:08.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:09.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:09.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:09.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:09.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:10.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:10.559+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:10.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:10.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:11.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:11.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:11.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:11.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:12.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:12.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:12.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:12.855+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:13.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:13.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:13.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:13.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:14.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:14.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:14.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:14.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:15.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:15.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:15.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:15.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:16.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:16.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:16.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:16.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:17.545 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:17.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:17.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:17.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:18.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:18.579+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:18.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:18.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:19.539 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:19.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:19.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:19.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:20.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:20.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:20.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:20.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:21.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:21.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:21.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:21.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:22.490 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:22.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:22.895 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:22.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:23.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:23.483+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:23.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:23.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:24.451 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:24.447+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:24.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:24.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:25.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:25.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:25.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:25.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:26.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:26.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:26.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:26.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:27.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:27.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:27.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:27.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:28.517 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:28.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:28.997 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:28.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:29.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:29.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:29.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:29.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:30.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:30.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:30.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:30.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:31.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:31.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:31.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:31.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:32.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:32.514+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:32.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:32.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:33.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:33.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:33.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:33.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:34.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:34.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:34.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:34.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:35.436 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:35.430+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:35.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:35.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:36.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:36.450+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:36.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:36.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:37.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:37.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:37.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:37.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:38.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:38.514+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:38.974 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:38.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:39.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:39.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:39.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:39.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:40.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:40.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:40.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:40.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:41.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:41.426+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:41.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:41.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:42.450 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:42.442+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:42.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:42.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:43.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:43.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:43.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:43.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:44.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:44.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:44.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:44.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:45.443 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:45.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:45.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:45.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:46.453 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:46.446+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:46.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:46.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:47.440 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:47.434+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:47.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:47.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:48.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:48.402+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:48.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:48.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:49.443 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:49.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:49.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:49.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:50.488 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:50.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:50.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:50.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:51.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:51.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:51.982 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:51.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:52.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:52.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:52.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:52.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:53.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:53.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:53.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:53.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:54.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:54.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:54.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:54.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:55.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:55.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:55.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:55.870+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:56.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:56.538+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:56.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:56.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:57.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:57.510+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:57.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:57.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:58.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:58.538+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:58.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:58.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:59.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:41:59.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:41:59.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:41:59.854+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:00.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:00.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:00.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:00.818+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:01.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:01.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:01.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:01.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:02.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:02.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:02.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:02.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:03.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:03.526+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:03.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:03.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:04.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:04.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:04.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:04.806+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:05.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:05.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:05.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:05.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:06.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:06.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:06.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:06.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:07.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:07.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:07.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:07.806+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:08.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:08.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:08.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:08.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:09.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:09.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:09.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:09.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:10.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:10.650+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:10.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:10.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:11.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:11.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:11.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:11.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:12.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:12.646+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:12.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:12.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:13.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:13.658+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:13.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:13.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:14.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:14.670+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:14.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:14.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:15.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:15.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:15.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:15.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:16.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:16.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:16.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:16.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:17.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:17.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:17.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:17.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:18.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:18.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:18.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:18.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:19.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:19.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:19.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:19.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:20.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:20.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:20.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:20.802+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:21.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:21.802+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:21.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:21.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:22.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:22.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:22.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:22.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:23.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:23.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:23.817 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:23.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:24.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:24.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:24.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:24.805+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:25.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:25.789+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:25.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:25.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:26.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:26.741+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:26.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:26.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:27.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:27.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:27.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:27.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:28.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:28.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:28.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:28.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:29.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:29.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:29.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:29.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:30.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:30.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:30.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:30.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:31.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:31.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:31.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:31.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:32.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:32.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:32.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:32.765+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:33.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:33.721+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:33.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:33.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:34.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:34.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:34.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:34.745+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:35.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:35.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:35.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:35.705+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:36.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:36.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:36.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:36.753+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:37.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:37.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:37.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:37.757+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:38.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:38.753+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:38.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:38.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:39.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:39.713+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:39.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:39.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:40.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:40.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:40.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:40.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:41.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:41.669+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:41.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:41.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:42.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:42.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:42.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:42.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:43.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:43.713+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:43.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:43.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:44.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:44.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:44.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:44.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:45.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:45.749+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:45.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:45.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:46.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:46.729+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:46.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:46.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:47.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:47.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:47.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:47.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:48.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:48.729+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:48.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:48.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:49.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:49.773+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:49.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:49.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:50.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:50.733+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:50.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:50.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:51.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:51.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:51.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:51.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:52.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:52.785+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:52.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:52.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:53.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:53.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:53.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:53.833+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:54.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:54.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:54.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:54.877+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:55.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:55.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:55.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:55.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:56.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:56.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:56.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:56.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:57.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:57.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:57.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:57.901+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:58.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:58.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:58.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:58.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:59.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:42:59.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:42:59.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:42:59.877+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:00.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:00.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:00.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:00.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:01.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:01.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:01.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:01.797+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:02.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:02.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:02.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:02.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:03.808 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:03.801+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:03.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:03.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:04.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:04.781+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:04.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:04.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:05.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:05.769+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:05.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:05.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:06.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:06.725+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:06.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:06.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:07.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:07.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:07.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:07.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:08.060 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T13:43:08.057+0000 7f6129f04700 0 -- 172.21.15.137:0/3659342895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d522283180 msgr2=0x55d522290dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-16T13:43:08.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:08.673+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:08.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:08.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:09.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:09.677+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:09.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:09.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:10.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:10.629+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:10.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:10.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:11.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:11.621+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:11.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:11.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:12.610 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:12.605+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:12.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:12.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:13.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:13.597+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:13.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:13.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:14.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:14.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:14.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:14.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:15.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:15.537+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:15.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:15.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:16.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:16.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:16.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:16.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:17.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:17.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:17.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:17.884+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:18.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:18.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:18.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:18.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:19.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:19.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:19.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:19.896+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:20.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:20.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:20.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:20.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:21.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:21.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:21.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:21.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:22.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:22.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:22.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:22.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:23.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:23.512+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:23.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:23.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:24.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:24.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:24.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:24.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:25.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:25.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:25.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:25.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:26.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:26.612+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:26.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:26.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:27.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:27.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:27.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:27.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:28.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:28.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:28.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:28.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:29.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:29.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:29.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:29.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:30.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:30.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:30.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:30.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:31.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:31.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:31.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:31.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:32.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:32.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:32.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:32.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:33.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:33.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:33.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:33.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:34.627 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:34.624+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:34.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:34.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:35.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:35.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:35.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:35.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:36.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:36.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:36.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:36.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:37.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:37.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:37.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:37.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:38.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:38.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:38.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:38.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:39.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:39.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:39.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:39.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:40.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:40.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:40.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:40.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:41.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:41.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:41.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:41.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:42.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:42.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:42.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:42.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:43.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:43.652+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:43.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:43.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:44.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:44.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:44.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:44.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:45.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:45.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:45.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:45.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:46.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:46.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:46.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:46.884+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:47.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:47.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:47.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:47.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:48.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:48.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:48.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:48.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:49.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:49.788+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:49.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:49.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:50.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:50.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:50.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:50.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:51.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:51.772+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:51.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:51.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:52.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:52.776+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:52.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:52.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:53.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:53.728+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:53.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:53.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:54.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:54.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:54.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:54.832+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:55.712 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:55.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:55.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:55.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:56.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:56.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:56.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:56.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:57.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:57.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:57.787 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:57.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:58.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:58.732+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:58.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:58.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:59.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:43:59.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:43:59.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:43:59.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:00.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:00.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:00.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:00.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:01.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:01.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:01.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:01.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:02.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:02.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:02.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:02.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:03.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:03.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:03.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:03.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:04.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:04.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:04.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:04.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:05.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:05.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:05.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:05.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:06.732 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:06.728+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:06.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:06.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:07.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:07.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:07.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:07.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:08.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:08.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:08.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:08.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:09.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:09.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:09.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:09.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:10.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:10.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:10.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:10.832+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:11.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:11.788+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:11.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:11.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:12.778 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:12.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:12.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:12.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:13.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:13.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:13.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:13.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:14.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:14.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:14.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:14.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:15.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:15.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:15.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:15.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:16.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:16.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:16.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:16.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:17.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:17.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:17.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:17.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:18.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:18.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:18.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:18.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:19.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:19.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:19.894 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:19.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:20.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:20.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:20.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:20.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:21.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:21.867+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:21.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:21.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:22.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:22.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:22.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:22.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:23.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:23.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:23.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:23.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:24.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:24.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:24.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:24.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:25.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:25.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:26.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:25.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:26.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:26.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:27.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:27.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:27.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:27.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:28.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:28.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:28.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:28.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:29.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:29.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:29.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:29.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:30.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:30.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:30.929 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:30.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:31.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:31.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:31.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:31.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:32.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:32.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:32.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:32.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:32.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:32.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:33.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:33.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:34.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:34.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:34.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:34.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:35.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:35.043+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:36.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:35.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:36.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:36.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:36.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:36.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:37.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:37.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:37.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:37.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:38.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:38.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:38.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:38.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:39.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:39.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:40.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:40.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:40.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:40.115+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:41.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:41.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:41.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:41.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:42.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:42.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:42.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:42.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:43.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:43.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:43.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:43.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:44.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:44.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:44.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:44.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:45.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:45.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:45.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:45.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:46.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:46.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:46.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:46.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:47.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:47.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:47.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:47.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:48.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:48.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:48.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:48.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:49.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:49.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:49.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:49.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:50.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:50.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:50.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:50.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:51.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:51.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:51.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:51.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:52.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:52.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:52.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:52.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:53.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:53.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:53.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:53.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:54.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:54.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:54.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:54.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:55.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:55.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:55.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:55.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:56.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:56.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:56.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:56.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:57.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:57.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:57.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:57.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:58.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:58.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:58.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:58.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:59.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:44:59.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:44:59.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:44:59.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:00.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:00.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:00.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:00.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:01.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:01.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:01.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:01.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:02.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:02.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:02.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:02.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:03.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:03.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:03.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:03.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:04.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:04.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:04.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:04.207+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:05.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:05.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:05.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:05.187+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:06.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:05.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:06.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:06.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:07.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:07.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:07.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:07.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:08.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:08.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:08.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:08.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:09.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:09.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:09.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:09.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:10.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:10.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:10.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:10.098+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:11.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:11.058+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:11.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:11.070+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:12.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:12.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:12.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:12.098+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:13.062 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:13.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:13.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:13.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:14.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:14.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:14.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:14.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:15.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:15.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:15.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:15.106+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:16.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:16.094+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:16.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:16.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:17.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:17.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:17.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:17.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:18.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:18.134+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:18.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:18.178+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:19.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:19.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:19.180 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:19.174+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:20.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:20.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:20.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:20.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:21.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:21.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:21.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:21.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:22.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:22.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:22.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:22.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:23.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:23.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:23.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:23.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:24.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:24.154+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:24.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:24.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:25.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:25.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:25.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:25.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:26.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:26.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:26.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:26.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:27.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:27.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:27.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:27.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:28.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:28.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:28.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:28.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:29.110 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:29.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:29.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:29.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:30.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:30.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:30.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:30.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:31.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:31.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:31.242 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:31.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:32.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:32.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:32.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:32.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:33.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:33.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:33.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:33.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:34.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:34.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:34.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:34.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:35.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:35.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:35.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:35.258+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:36.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:36.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:36.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:36.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:37.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:37.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:37.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:37.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:38.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:38.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:38.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:38.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:39.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:39.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:39.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:39.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:40.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:40.214+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:40.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:40.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:41.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:41.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:41.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:41.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:42.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:42.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:42.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:42.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:43.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:43.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:43.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:43.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:44.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:44.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:44.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:44.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:45.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:45.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:45.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:45.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:46.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:46.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:46.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:46.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:47.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:47.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:47.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:47.410+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:48.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:48.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:48.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:48.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:49.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:49.258+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:49.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:49.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:50.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:50.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:50.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:50.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:51.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:51.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:51.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:51.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:52.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:52.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:52.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:52.482+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:53.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:53.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:53.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:53.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:54.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:54.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:54.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:54.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:55.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:55.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:55.494 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:55.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:56.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:56.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:56.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:56.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:57.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:57.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:57.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:57.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:58.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:58.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:58.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:58.510+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:59.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:45:59.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:45:59.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:45:59.542+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:00.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:00.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:00.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:00.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:01.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:01.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:01.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:01.510+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:02.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:02.157+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:02.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:02.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:03.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:03.189+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:03.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:03.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:04.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:04.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:04.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:04.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:05.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:05.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:05.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:05.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:06.266 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:06.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:06.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:06.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:07.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:07.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:07.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:07.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:08.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:08.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:08.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:08.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:09.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:09.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:09.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:09.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:10.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:10.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:10.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:10.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:11.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:11.257+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:11.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:11.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:12.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:12.233+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:12.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:12.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:13.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:13.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:13.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:13.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:14.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:14.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:14.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:14.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:15.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:15.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:15.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:15.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:16.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:16.229+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:16.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:16.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:17.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:17.185+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:17.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:17.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:18.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:18.193+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:18.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:18.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:19.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:19.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:19.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:19.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:20.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:20.221+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:20.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:20.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:21.273 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:21.265+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:21.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:21.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:22.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:22.237+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:22.433 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:22.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:23.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:23.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:23.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:23.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:24.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:24.281+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:24.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:24.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:25.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:25.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:25.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:25.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:26.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:26.333+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:26.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:26.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:27.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:27.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:27.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:27.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:28.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:28.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:28.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:28.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:29.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:29.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:29.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:29.437+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:30.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:30.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:30.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:30.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:31.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:31.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:31.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:31.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:32.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:32.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:32.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:32.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:33.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:33.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:33.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:33.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:34.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:34.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:34.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:34.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:35.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:35.465+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:35.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:35.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:36.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:36.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:36.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:36.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:37.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:37.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:37.682 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:37.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:38.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:38.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:38.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:38.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:39.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:39.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:39.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:39.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:40.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:40.505+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:40.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:40.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:41.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:41.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:41.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:41.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:42.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:42.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:42.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:42.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:43.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:43.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:43.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:43.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:44.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:44.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:44.647 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:44.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:45.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:45.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:45.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:45.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:46.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:46.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:46.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:46.653+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:47.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:47.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:47.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:47.705+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:48.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:48.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:48.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:48.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:49.523 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:49.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:49.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:49.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:50.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:50.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:50.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:50.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:51.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:51.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:51.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:51.697+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:52.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:52.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:52.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:52.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:53.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:53.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:53.672 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:53.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:54.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:54.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:54.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:54.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:55.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:55.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:55.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:55.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:56.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:56.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:56.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:56.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:57.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:57.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:57.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:57.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:58.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:58.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:58.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:58.648+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:59.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:46:59.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:46:59.611 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:46:59.608+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:00.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:00.576+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:00.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:00.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:01.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:01.576+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:01.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:01.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:02.539 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:02.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:02.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:02.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:03.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:03.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:03.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:03.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:04.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:04.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:04.704 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:04.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:05.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:05.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:05.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:05.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:06.653 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:06.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:06.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:06.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:07.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:07.600+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:07.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:07.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:08.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:08.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:08.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:08.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:09.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:09.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:09.729 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:09.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:10.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:10.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:10.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:10.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:11.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:11.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:11.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:11.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:12.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:12.672+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:12.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:12.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:13.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:13.628+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:13.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:13.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:14.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:14.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:14.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:14.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:15.659 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:15.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:15.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:15.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:16.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:16.656+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:16.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:16.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:17.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:17.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:17.703 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:17.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:18.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:18.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:18.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:18.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:19.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:19.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:19.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:19.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:20.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:20.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:20.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:20.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:21.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:21.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:21.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:21.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:22.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:22.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:22.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:22.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:23.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:23.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:23.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:23.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:24.624 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:24.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:24.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:24.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:25.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:25.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:25.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:25.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:26.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:26.600+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:26.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:26.736+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:27.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:27.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:27.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:27.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:28.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:28.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:28.651 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:28.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:29.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:29.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:29.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:29.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:30.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:30.564+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:30.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:30.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:31.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:31.544+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:31.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:31.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:32.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:32.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:32.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:32.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:33.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:33.520+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:33.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:33.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:34.484 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:34.480+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:34.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:34.760+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:35.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:35.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:35.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:35.728+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:36.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:36.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:36.740 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:36.736+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:37.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:37.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:37.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:37.732+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:38.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:38.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:38.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:38.764+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:39.298 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:39.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:39.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:39.756+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:40.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:40.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:40.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:40.764+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:41.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:41.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:41.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:41.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:42.370 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:42.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:42.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:42.776+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:43.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:43.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:43.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:43.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:44.381 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:44.376+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:44.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:44.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:45.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:45.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:45.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:45.732+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:46.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:46.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:46.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:46.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:47.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:47.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:47.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:47.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:48.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:48.476+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:48.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:48.792+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:49.497 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:49.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:49.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:49.784+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:50.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:50.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:50.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:50.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:51.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:51.487+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:51.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:51.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:52.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:52.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:52.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:52.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:53.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:53.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:53.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:53.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:54.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:54.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:54.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:54.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:55.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:55.515+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:55.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:55.763+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:56.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:56.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:56.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:56.771+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:57.502 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:57.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:57.740 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:57.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:58.465 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:58.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:58.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:58.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:59.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:47:59.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:47:59.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:47:59.747+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:00.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:00.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:00.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:00.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:01.540 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:01.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:01.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:01.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:02.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:02.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:02.803 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:02.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:03.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:03.515+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:03.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:03.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:04.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:04.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:04.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:04.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:05.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:05.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:05.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:05.727+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:06.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:06.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:06.702 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:06.695+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:07.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:07.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:07.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:07.667+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:08.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:08.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:08.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:08.667+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:09.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:09.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:09.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:09.703+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:10.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:10.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:10.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:10.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:11.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:11.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:11.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:11.679+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:12.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:12.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:12.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:12.699+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:13.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:13.579+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:13.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:13.671+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:14.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:14.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:14.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:14.675+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:15.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:15.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:15.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:15.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:16.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:16.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:16.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:16.755+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:17.615 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:17.611+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:17.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:17.755+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:18.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:18.655+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:18.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:18.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:19.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:19.619+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:19.775 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:19.771+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:20.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:20.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:20.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:20.747+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:21.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:21.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:21.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:21.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:22.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:22.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:22.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:22.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:23.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:23.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:23.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:23.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:24.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:24.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:24.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:24.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:25.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:25.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:25.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:25.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:26.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:26.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:26.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:26.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:27.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:27.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:27.745 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:27.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:28.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:28.619+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:28.707 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:28.703+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:29.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:29.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:29.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:29.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:30.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:30.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:30.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:30.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:31.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:31.723+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:31.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:31.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:32.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:32.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:32.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:32.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:33.749 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:33.743+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:33.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:33.751+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:34.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:34.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:34.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:34.763+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:35.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:35.735+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:35.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:35.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:36.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:36.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:36.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:36.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:37.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:37.727+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:37.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:37.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:38.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:38.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:38.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:38.827+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:39.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:39.663+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:39.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:39.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:40.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:40.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:40.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:40.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:41.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:41.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:41.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:41.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:42.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:42.663+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:42.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:42.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:43.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:43.702+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:43.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:43.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:44.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:44.662+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:44.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:44.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:45.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:45.658+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:45.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:45.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:46.627 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:46.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:46.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:46.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:47.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:47.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:47.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:47.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:48.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:48.594+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:48.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:48.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:49.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:49.606+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:49.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:49.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:50.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:50.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:50.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:50.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:51.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:51.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:51.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:51.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:52.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:52.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:52.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:52.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:53.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:53.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:53.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:53.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:54.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:54.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:54.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:54.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:55.639 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:55.634+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:55.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:55.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:56.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:56.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:56.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:56.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:57.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:57.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:57.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:57.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:58.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:58.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:58.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:58.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:59.603 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:48:59.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:48:59.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:48:59.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:00.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:00.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:00.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:00.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:01.615 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:01.610+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:01.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:01.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:02.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:02.618+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:02.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:02.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:03.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:03.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:03.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:03.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:04.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:04.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:04.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:04.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:05.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:05.674+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:05.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:05.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:06.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:06.714+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:06.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:06.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:07.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:07.742+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:07.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:07.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:08.756 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:08.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:08.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:08.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:09.728 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:09.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:09.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:09.742+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:10.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:10.694+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:10.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:10.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:11.727 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:11.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:11.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:11.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:12.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:12.698+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:12.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:12.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:13.745 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:13.738+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:13.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:13.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:14.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:14.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:14.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:14.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:15.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:15.686+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:15.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:15.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:16.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:16.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:16.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:16.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:17.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:17.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:17.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:17.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:18.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:18.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:18.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:18.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:19.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:19.558+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:19.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:19.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:20.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:20.610+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:20.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:20.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:21.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:21.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:21.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:21.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:22.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:22.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:22.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:22.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:23.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:23.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:23.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:23.958+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:24.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:24.550+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:24.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:24.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:25.552 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:25.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:26.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:25.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:26.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:26.506+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:26.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:26.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:27.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:27.530+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:27.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:27.938+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:28.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:28.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:28.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:28.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:29.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:29.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:29.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:29.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:30.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:30.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:31.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:30.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:31.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:31.554+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:32.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:32.026+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:32.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:32.574+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:33.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:33.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:33.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:33.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:34.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:34.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:34.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:34.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:35.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:35.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:35.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:35.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:36.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:36.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:36.567 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:36.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:37.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:37.133+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:37.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:37.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:38.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:38.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:38.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:38.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:39.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:39.137+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:39.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:39.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:40.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:40.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:40.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:40.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:41.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:41.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:41.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:41.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:42.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:42.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:42.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:42.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:43.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:43.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:43.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:43.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:44.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:44.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:44.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:44.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:45.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:45.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:45.406 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:45.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:46.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:46.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:46.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:46.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:47.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:47.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:47.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:47.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:47.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:47.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:48.501 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:48.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:49.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:49.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:49.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:49.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:50.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:50.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:50.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:50.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:51.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:51.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:51.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:51.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:52.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:52.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:52.516 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:52.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:53.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:53.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:53.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:53.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:54.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:54.117+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:54.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:54.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:55.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:55.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:55.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:55.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:56.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:56.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:56.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:56.533+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:57.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:57.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:57.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:57.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:58.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:58.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:58.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:58.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:59.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:49:59.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:49:59.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:49:59.537+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:00.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:00.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:00.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:00.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:01.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:01.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:01.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:01.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:02.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:02.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:02.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:02.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:03.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:03.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:03.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:03.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:04.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:04.045+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:04.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:04.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:05.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:05.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:05.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:05.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:05.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:05.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:06.461 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:06.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:07.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:07.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:07.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:07.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:08.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:07.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:08.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:08.457+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:09.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:09.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:09.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:09.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:10.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:10.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:10.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:10.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:11.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:11.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:11.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:11.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:12.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:12.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:12.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:12.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:12.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:12.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:13.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:13.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:14.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:14.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:14.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:14.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:15.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:15.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:15.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:15.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:16.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:16.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:16.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:16.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:17.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:17.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:17.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:17.409+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:18.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:18.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:18.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:18.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:19.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:19.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:19.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:19.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:19.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:19.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:20.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:20.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:21.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:21.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:21.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:21.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:22.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:22.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:22.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:22.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:23.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:23.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:23.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:23.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:24.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:24.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:24.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:24.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:25.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:25.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:25.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:25.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:26.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:26.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:26.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:26.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:27.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:27.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:27.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:27.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:28.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:28.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:28.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:28.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:29.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:29.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:29.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:29.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:29.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:29.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:30.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:30.228+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:31.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:30.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:31.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:31.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:32.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:32.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:32.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:32.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:33.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:33.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:33.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:33.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:34.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:34.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:34.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:34.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:35.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:35.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:35.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:35.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:36.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:36.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:36.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:36.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:37.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:37.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:37.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:37.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:37.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:37.984+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:38.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:38.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:39.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:39.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:39.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:39.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:40.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:40.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:40.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:40.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:41.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:41.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:41.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:41.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:42.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:42.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:42.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:42.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:43.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:43.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:43.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:43.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:44.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:44.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:44.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:44.320+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:45.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:45.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:45.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:45.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:46.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:46.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:46.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:46.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:47.230 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:47.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:47.399 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:47.396+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:48.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:48.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:48.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:48.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:49.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:49.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:49.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:49.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:50.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:50.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:50.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:50.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:51.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:51.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:51.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:51.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:52.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:52.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:52.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:52.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:53.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:53.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:53.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:53.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:54.201 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:54.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:54.468 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:54.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:55.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:55.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:55.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:55.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:56.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:56.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:56.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:56.504+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:57.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:57.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:57.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:57.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:58.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:58.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:58.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:58.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:59.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:50:59.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:50:59.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:50:59.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:00.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:00.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:00.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:00.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:01.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:01.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:01.471 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:01.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:02.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:02.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:02.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:02.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:03.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:03.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:03.536 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:03.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:04.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:04.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:04.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:04.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:05.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:05.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:05.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:05.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:06.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:06.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:06.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:06.424+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:07.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:07.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:07.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:07.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:08.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:08.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:08.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:08.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:09.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:09.292+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:09.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:09.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:10.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:10.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:10.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:10.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:11.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:11.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:11.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:11.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:12.280 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:12.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:12.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:12.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:13.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:13.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:13.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:13.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:14.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:14.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:14.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:14.448+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:15.305 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:15.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:15.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:15.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:16.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:16.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:16.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:16.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:17.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:17.312+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:17.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:17.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:18.350 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:18.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:18.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:18.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:19.396 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:19.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:19.567 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:19.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:20.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:20.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:20.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:20.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:21.417 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:21.412+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:21.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:21.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:22.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:22.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:22.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:22.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:23.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:23.387+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:23.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:23.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:24.358 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:24.355+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:24.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:24.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:25.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:25.387+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:25.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:25.571+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:26.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:26.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:26.627 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:26.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:27.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:27.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:27.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:27.595+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:28.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:28.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:28.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:28.615+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:29.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:29.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:29.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:29.579+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:30.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:30.299+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:30.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:30.563+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:31.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:31.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:31.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:31.591+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:32.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:32.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:32.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:32.567+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:33.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:33.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:33.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:33.583+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:34.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:34.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:34.580 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:34.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:35.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:35.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:35.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:35.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:36.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:36.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:36.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:36.499+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:37.140 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:37.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:37.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:37.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:38.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:38.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:38.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:38.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:39.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:39.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:39.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:39.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:40.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:40.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:40.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:40.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:41.332 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:41.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:41.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:41.367+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:42.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:42.339+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:42.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:42.383+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:43.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:43.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:43.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:43.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:44.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:44.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:44.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:44.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:45.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:45.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:45.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:45.323+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:46.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:46.295+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:46.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:46.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:47.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:47.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:47.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:47.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:48.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:48.299+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:48.385 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:48.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:49.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:49.287+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:49.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:49.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:50.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:50.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:50.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:50.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:51.301 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:51.295+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:51.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:51.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:52.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:52.247+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:52.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:52.399+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:53.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:53.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:53.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:53.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:54.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:54.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:54.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:54.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:55.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:55.203+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:55.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:55.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:56.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:56.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:56.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:56.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:57.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:57.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:57.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:57.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:58.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:58.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:58.416 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:58.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:59.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:51:59.207+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:51:59.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:51:59.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:00.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:00.167+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:00.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:00.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:01.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:01.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:01.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:01.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:02.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:02.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:02.514 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:02.507+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:03.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:03.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:03.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:03.483+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:04.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:04.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:04.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:04.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:05.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:05.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:05.518 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:05.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:06.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:06.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:06.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:06.539+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:07.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:07.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:07.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:07.515+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:08.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:08.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:08.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:08.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:09.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:09.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:09.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:09.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:10.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:10.251+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:10.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:10.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:11.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:11.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:11.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:11.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:12.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:12.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:12.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:12.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:13.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:13.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:13.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:13.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:14.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:14.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:14.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:14.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:15.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:15.275+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:15.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:15.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:16.278 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:16.274+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:16.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:16.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:17.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:17.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:17.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:17.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:18.286 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:18.282+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:18.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:18.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:19.258 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:19.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:19.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:19.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:20.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:20.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:20.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:20.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:21.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:21.286+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:21.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:21.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:22.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:22.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:22.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:22.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:23.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:23.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:23.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:23.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:24.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:24.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:24.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:24.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:25.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:25.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:25.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:25.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:26.323 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:26.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:26.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:26.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:27.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:27.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:27.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:27.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:28.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:28.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:28.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:28.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:29.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:29.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:29.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:29.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:30.255 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:30.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:30.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:30.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:31.253 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:31.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:31.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:31.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:32.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:32.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:32.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:32.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:33.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:33.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:33.353 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:33.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:34.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:34.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:34.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:34.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:35.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:35.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:35.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:35.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:36.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:36.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:36.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:36.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:37.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:37.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:37.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:37.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:38.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:38.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:38.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:38.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:39.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:39.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:39.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:39.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:40.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:40.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:40.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:40.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:41.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:41.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:41.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:41.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:42.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:42.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:42.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:42.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:43.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:43.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:43.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:43.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:44.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:44.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:44.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:44.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:45.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:45.050+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:45.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:45.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:46.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:46.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:46.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:46.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:47.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:47.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:47.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:47.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:48.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:48.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:48.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:48.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:49.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:49.026+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:49.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:49.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:50.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:50.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:50.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:50.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:51.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:51.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:51.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:51.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:52.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:52.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:52.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:52.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:53.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:53.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:53.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:53.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:54.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:54.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:54.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:54.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:55.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:55.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:55.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:55.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:56.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:56.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:56.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:56.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:57.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:57.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:57.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:57.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:58.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:58.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:58.308 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:58.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:59.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:52:59.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:52:59.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:52:59.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:00.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:00.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:00.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:00.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:01.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:01.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:01.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:01.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:02.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:02.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:02.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:02.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:03.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:03.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:03.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:03.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:04.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:04.126+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:04.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:04.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:05.158 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:05.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:05.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:05.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:06.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:06.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:06.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:06.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:07.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:07.178+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:07.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:07.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:08.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:08.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:08.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:08.370+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:09.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:09.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:09.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:09.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:10.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:10.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:10.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:10.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:11.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:11.261+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:11.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:11.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:12.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:12.297+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:12.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:12.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:13.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:13.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:13.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:13.277+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:14.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:14.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:14.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:14.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:15.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:15.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:15.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:15.313+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:16.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:16.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:16.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:16.333+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:17.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:17.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:17.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:17.317+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:18.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:18.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:18.314 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:18.305+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:19.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:19.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:19.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:19.325+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:20.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:20.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:20.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:20.377+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:21.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:21.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:21.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:21.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:22.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:22.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:22.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:22.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:23.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:23.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:23.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:23.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:24.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:24.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:24.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:24.437+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:25.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:25.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:25.472 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:25.465+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:26.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:26.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:26.449 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:26.441+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:27.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:27.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:27.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:27.441+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:28.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:28.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:28.433 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:28.425+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:29.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:29.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:29.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:29.401+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:30.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:30.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:30.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:30.397+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:31.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:31.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:31.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:31.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:32.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:32.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:32.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:32.473+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:33.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:33.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:33.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:33.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:34.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:34.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:34.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:34.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:35.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:35.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:35.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:35.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:36.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:36.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:36.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:36.453+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:37.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:37.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:37.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:37.449+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:38.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:38.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:38.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:38.473+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:39.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:39.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:39.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:39.433+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:40.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:40.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:40.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:40.473+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:41.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:41.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:41.464 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:41.457+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:42.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:42.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:42.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:42.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:43.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:43.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:43.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:43.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:44.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:44.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:44.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:44.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:45.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:45.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:45.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:45.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:46.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:46.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:46.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:46.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:47.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:47.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:47.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:47.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:48.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:48.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:48.434 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:48.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:49.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:49.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:49.463 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:49.457+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:50.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:50.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:50.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:50.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:51.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:51.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:51.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:51.481+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:52.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:52.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:52.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:52.477+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:53.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:53.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:53.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:53.453+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:54.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:54.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:54.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:54.481+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:55.401 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:55.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:55.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:55.533+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:56.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:56.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:56.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:56.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:57.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:57.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:57.522 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:57.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:58.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:58.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:58.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:58.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:59.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:53:59.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:53:59.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:53:59.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:00.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:00.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:00.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:00.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:01.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:01.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:01.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:01.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:02.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:02.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:02.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:02.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:03.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:03.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:03.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:03.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:04.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:04.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:04.577 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:04.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:05.332 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:05.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:05.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:05.576+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:06.334 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:06.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:06.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:06.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:07.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:07.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:07.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:07.556+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:08.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:08.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:08.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:08.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:09.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:09.308+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:09.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:09.556+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:10.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:10.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:10.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:10.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:11.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:11.320+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:11.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:11.572+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:12.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:12.332+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:12.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:12.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:13.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:13.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:13.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:13.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:14.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:14.344+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:14.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:14.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:15.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:15.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:15.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:15.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:16.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:16.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:16.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:16.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:17.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:17.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:17.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:17.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:18.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:18.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:18.618 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:18.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:19.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:19.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:19.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:19.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:20.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:20.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:20.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:20.616+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:21.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:21.288+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:21.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:21.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:22.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:22.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:22.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:22.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:23.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:23.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:23.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:23.564+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:24.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:24.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:24.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:24.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:25.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:25.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:25.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:25.588+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:26.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:26.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:26.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:26.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:27.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:27.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:27.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:27.540+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:28.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:28.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:28.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:28.512+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:29.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:29.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:29.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:29.528+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:30.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:30.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:30.492 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:30.488+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:31.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:31.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:31.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:31.520+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:32.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:32.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:32.490 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:32.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:33.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:33.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:33.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:33.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:34.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:34.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:34.452 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:34.448+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:35.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:35.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:35.412 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:35.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:36.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:36.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:36.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:36.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:37.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:37.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:37.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:37.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:38.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:38.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:38.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:38.468+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:39.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:39.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:39.510 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:39.508+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:40.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:40.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:40.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:40.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:41.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:41.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:41.538 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:41.532+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:42.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:42.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:42.501 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:42.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:43.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:43.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:43.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:43.524+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:44.188 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:44.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:44.508 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:44.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:45.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:45.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:45.474 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:45.472+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:46.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:46.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:46.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:46.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:47.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:47.232+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:47.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:47.512+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:48.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:48.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:48.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:48.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:49.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:49.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:49.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:49.496+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:50.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:50.276+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:50.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:50.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:51.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:51.320+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:51.494 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:51.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:52.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:52.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:52.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:52.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:53.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:53.316+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:53.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:53.472+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:54.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:54.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:54.461 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:54.456+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:55.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:55.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:55.496 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:55.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:56.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:56.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:56.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:56.499+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:57.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:57.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:57.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:57.503+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:58.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:58.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:58.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:58.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:59.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:54:59.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:54:59.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:54:59.543+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:00.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:00.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:00.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:00.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:01.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:01.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:01.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:01.531+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:02.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:02.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:02.499 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:02.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:03.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:03.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:03.486 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:03.483+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:04.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:04.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:04.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:04.439+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:05.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:05.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:05.486 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:05.479+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:06.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:06.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:06.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:06.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:07.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:07.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:07.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:07.455+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:08.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:08.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:08.414 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:08.411+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:09.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:09.155+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:09.382 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:09.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:10.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:10.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:10.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:10.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:11.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:11.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:11.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:11.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:12.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:12.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:12.432 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:12.427+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:13.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:13.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:13.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:13.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:14.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:14.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:14.448 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:14.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:15.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:15.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:15.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:15.475+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:16.107 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:16.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:16.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:16.435+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:17.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:17.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:17.473 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:17.467+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:18.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:18.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:18.476 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:18.471+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:19.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:19.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:19.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:19.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:20.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:20.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:20.516 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:20.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:21.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:21.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:21.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:21.535+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:22.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:22.323+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:22.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:22.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:23.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:23.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:23.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:23.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:24.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:24.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:24.561 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:24.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:25.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:25.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:25.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:25.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:26.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:26.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:26.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:26.555+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:27.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:27.227+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:27.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:27.523+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:28.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:28.243+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:28.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:28.575+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:29.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:29.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:29.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:29.603+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:30.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:30.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:30.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:30.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:31.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:31.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:31.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:31.631+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:32.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:32.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:32.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:32.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:33.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:33.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:33.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:33.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:34.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:34.295+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:34.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:34.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:35.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:35.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:35.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:35.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:36.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:36.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:36.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:36.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:37.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:37.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:37.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:37.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:38.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:38.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:38.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:38.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:39.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:39.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:39.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:39.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:40.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:40.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:40.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:40.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:41.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:41.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:41.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:41.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:42.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:42.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:42.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:42.767+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:43.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:43.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:43.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:43.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:44.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:44.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:44.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:44.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:45.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:45.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:45.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:45.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:46.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:46.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:46.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:46.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:47.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:47.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:47.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:47.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:48.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:48.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:48.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:48.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:49.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:49.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:49.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:49.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:50.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:50.270+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:50.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:50.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:51.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:51.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:51.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:51.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:52.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:52.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:52.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:52.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:53.331 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:53.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:53.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:53.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:54.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:54.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:54.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:54.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:55.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:55.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:55.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:55.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:56.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:56.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:56.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:56.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:57.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:57.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:57.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:57.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:58.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:58.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:58.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:58.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:59.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:55:59.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:55:59.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:55:59.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:00.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:00.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:00.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:00.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:01.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:01.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:01.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:01.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:02.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:02.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:02.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:02.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:03.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:03.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:03.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:03.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:04.323 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:04.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:04.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:04.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:05.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:05.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:05.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:05.830+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:06.328 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:06.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:06.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:06.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:07.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:07.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:07.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:07.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:08.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:08.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:08.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:08.830+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:09.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:09.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:09.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:09.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:10.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:10.246+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:10.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:10.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:11.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:11.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:11.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:11.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:12.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:12.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:12.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:12.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:13.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:13.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:13.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:13.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:14.205 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:14.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:14.714 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:14.710+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:15.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:15.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:15.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:15.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:16.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:16.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:16.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:16.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:17.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:17.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:17.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:17.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:18.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:18.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:18.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:18.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:19.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:19.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:19.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:19.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:20.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:20.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:20.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:20.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:21.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:21.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:21.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:21.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:22.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:22.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:22.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:22.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:23.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:23.274+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:23.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:23.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:24.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:24.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:24.754 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:24.746+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:25.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:25.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:25.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:25.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:26.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:26.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:26.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:26.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:27.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:27.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:27.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:27.734+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:28.329 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:28.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:28.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:28.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:29.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:29.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:29.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:29.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:30.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:30.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:30.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:30.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:31.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:31.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:31.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:31.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:32.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:32.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:32.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:32.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:33.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:33.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:33.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:33.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:34.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:34.238+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:34.932 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:34.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:35.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:35.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:35.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:35.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:36.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:36.186+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:36.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:36.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:37.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:37.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:37.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:37.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:38.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:38.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:38.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:38.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:39.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:39.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:39.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:39.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:40.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:40.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:40.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:40.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:41.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:41.146+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:41.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:41.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:42.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:42.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:42.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:42.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:43.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:43.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:43.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:43.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:44.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:44.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:44.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:44.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:45.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:45.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:45.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:45.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:46.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:46.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:47.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:46.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:47.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:47.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:48.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:48.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:48.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:48.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:48.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:48.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:49.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:49.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:49.943 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:49.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:50.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:50.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:50.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:50.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:51.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:51.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:51.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:51.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:52.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:52.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:52.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:52.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:53.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:53.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:53.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:53.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:54.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:54.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:54.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:54.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:55.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:55.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:56.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:56.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:56.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:56.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:57.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:57.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:57.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:57.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:58.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:58.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:58.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:58.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:59.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:56:59.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:56:59.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:56:59.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:00.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:00.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:00.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:00.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:01.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:01.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:01.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:01.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:02.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:02.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:02.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:02.401+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:03.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:03.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:03.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:03.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:04.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:04.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:04.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:04.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:05.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:05.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:05.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:05.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:06.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:06.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:06.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:06.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:06.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:06.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:07.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:07.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:08.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:07.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:08.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:08.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:09.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:09.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:09.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:09.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:09.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:09.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:10.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:10.421+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:11.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:11.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:11.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:11.413+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:12.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:12.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:12.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:12.449+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:13.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:13.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:13.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:13.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:14.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:14.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:14.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:14.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:15.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:15.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:15.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:15.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:16.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:16.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:16.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:16.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:17.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:17.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:17.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:17.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:18.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:18.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:18.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:18.553+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:19.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:19.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:19.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:19.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:20.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:20.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:20.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:20.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:21.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:21.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:21.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:21.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:22.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:22.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:22.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:22.441+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:23.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:23.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:23.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:23.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:24.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:24.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:24.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:24.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:25.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:25.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:25.526 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:25.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:26.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:26.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:26.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:26.553+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:27.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:27.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:27.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:27.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:28.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:28.053+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:28.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:28.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:29.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:29.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:29.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:29.545+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:30.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:30.085+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:30.505 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:30.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:31.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:31.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:31.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:31.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:32.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:32.149+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:32.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:32.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:33.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:33.145+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:33.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:33.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:34.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:34.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:34.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:34.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:35.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:35.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:35.549 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:35.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:36.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:36.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:36.558 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:36.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:37.213 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:37.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:37.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:37.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:38.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:38.200+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:38.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:38.556+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:39.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:39.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:39.567 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:39.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:40.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:40.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:40.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:40.520+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:41.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:41.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:41.541 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:41.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:42.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:42.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:42.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:42.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:43.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:43.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:43.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:43.568+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:44.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:44.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:44.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:44.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:45.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:45.248+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:45.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:45.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:46.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:46.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:46.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:46.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:47.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:47.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:47.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:47.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:48.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:48.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:48.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:48.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:49.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:49.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:49.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:49.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:50.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:50.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:50.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:50.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:51.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:51.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:51.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:51.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:52.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:52.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:52.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:52.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:53.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:53.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:53.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:53.520+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:54.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:54.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:54.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:54.504+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:55.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:55.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:55.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:55.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:56.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:56.256+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:56.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:56.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:57.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:57.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:57.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:57.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:58.222 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:58.220+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:58.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:58.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:59.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:57:59.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:57:59.503 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:57:59.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:00.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:00.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:00.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:00.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:01.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:01.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:01.542 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:01.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:02.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:02.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:02.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:02.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:03.229 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:03.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:03.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:03.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:04.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:04.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:04.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:04.552+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:05.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:05.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:05.564 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:05.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:06.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:06.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:06.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:06.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:07.185 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:07.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:07.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:07.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:08.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:08.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:08.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:08.600+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:09.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:09.212+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:09.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:09.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:10.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:10.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:10.600 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:10.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:11.277 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:11.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:11.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:11.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:12.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:12.268+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:12.590 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:12.584+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:13.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:13.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:13.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:13.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:14.279 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:14.276+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:14.567 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:14.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:15.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:15.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:15.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:15.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:16.287 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:16.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:16.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:16.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:17.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:17.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:17.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:17.612+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:18.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:18.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:18.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:18.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:19.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:19.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:19.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:19.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:20.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:20.316+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:20.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:20.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:21.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:21.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:21.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:21.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:22.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:22.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:22.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:22.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:23.338 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:23.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:23.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:23.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:24.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:24.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:24.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:24.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:25.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:25.280+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:25.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:25.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:26.244 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:26.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:26.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:26.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:27.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:27.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:27.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:27.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:28.235 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:28.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:28.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:28.731+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:29.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:29.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:29.727 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:29.723+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:30.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:30.247+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:30.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:30.687+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:31.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:31.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:31.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:31.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:32.321 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:32.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:32.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:32.695+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:33.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:33.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:33.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:33.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:34.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:34.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:34.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:34.755+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:35.386 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:35.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:35.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:35.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:36.407 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:36.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:36.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:36.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:37.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:37.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:37.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:37.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:38.378 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:38.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:38.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:38.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:39.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:39.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:39.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:39.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:40.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:40.363+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:40.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:40.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:41.365 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:41.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:41.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:41.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:42.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:42.391+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:42.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:42.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:43.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:43.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:43.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:43.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:44.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:44.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:44.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:44.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:45.404 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:45.399+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:45.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:45.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:46.383 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:46.379+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:46.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:46.815+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:47.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:47.419+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:47.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:47.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:48.406 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:48.403+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:48.860 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:48.855+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:49.437 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:49.431+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:49.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:49.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:50.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:50.443+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:50.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:50.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:51.422 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:51.415+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:51.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:51.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:52.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:52.459+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:52.869 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:52.863+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:53.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:53.495+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:53.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:53.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:54.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:54.491+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:54.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:54.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:55.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:55.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:55.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:55.867+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:56.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:56.539+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:56.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:56.863+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:57.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:57.563+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:57.878 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:57.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:58.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:58.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:58.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:58.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:59.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:58:59.547+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:58:59.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:58:59.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:00.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:00.583+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:00.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:00.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:01.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:01.551+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:01.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:01.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:02.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:02.591+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:02.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:02.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:03.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:03.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:03.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:03.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:04.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:04.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:04.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:04.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:05.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:05.627+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:05.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:05.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:06.620 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:06.615+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:06.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:06.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:07.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:07.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:07.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:07.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:08.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:08.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:08.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:08.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:09.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:09.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:09.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:09.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:10.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:10.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:11.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:11.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:11.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:11.667+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:11.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:11.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:12.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:12.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:12.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:12.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:13.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:13.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:13.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:13.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:14.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:14.735+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:14.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:14.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:15.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:15.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:15.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:15.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:16.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:16.651+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:17.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:16.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:17.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:17.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:17.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:17.975+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:18.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:18.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:18.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:18.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:19.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:19.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:19.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:19.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:20.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:20.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:20.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:20.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:21.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:21.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:22.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:22.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:22.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:22.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:22.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:22.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:23.602 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:23.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:24.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:23.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:24.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:24.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:25.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:25.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:25.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:25.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:26.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:26.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:26.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:26.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:27.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:27.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:27.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:27.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:28.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:27.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:28.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:28.526+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:28.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:28.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:29.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:29.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:29.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:29.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:30.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:30.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:30.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:30.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:31.551 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:31.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:31.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:31.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:32.600 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:32.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:32.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:32.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:33.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:33.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:33.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:33.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:34.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:34.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:35.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:35.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:35.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:35.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:36.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:36.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:36.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:36.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:37.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:37.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:37.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:37.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:38.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:38.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:38.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:38.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:39.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:39.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:39.649 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:39.642+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:40.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:40.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:40.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:40.618+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:41.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:41.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:41.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:41.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:42.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:42.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:42.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:42.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:43.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:43.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:43.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:43.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:44.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:44.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:44.534 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:44.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:45.061 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:45.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:45.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:45.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:46.068 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:46.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:46.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:46.538+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:47.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:47.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:47.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:47.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:48.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:48.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:48.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:48.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:49.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:49.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:49.555 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:49.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:50.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:50.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:50.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:50.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:51.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:51.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:51.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:51.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:52.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:52.090+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:52.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:52.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:53.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:53.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:53.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:53.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:54.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:54.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:54.549 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:54.542+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:55.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:55.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:55.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:55.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:56.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:56.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:56.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:56.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:56.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:56.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:57.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:57.562+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:58.006 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:58.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:58.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:58.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:58.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:58.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:59.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T13:59:59.546+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T13:59:59.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T13:59:59.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:00.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:00.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:00.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:00.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:01.511 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:01.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:01.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:01.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:02.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:02.494+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:02.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:02.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:03.528 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:03.522+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:03.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:03.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:04.563 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:04.558+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:04.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:04.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:05.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:05.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:05.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:05.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:06.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:06.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:06.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:06.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:07.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:07.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:07.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:07.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:08.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:08.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:08.978 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:08.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:09.583 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:09.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:10.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:10.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:10.558 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:10.550+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:10.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:10.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:11.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:11.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:11.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:11.957+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:12.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:12.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:13.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:12.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:13.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:13.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:14.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:14.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:14.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:14.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:15.047 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:15.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:15.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:15.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:16.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:16.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:16.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:16.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:17.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:17.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:17.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:17.593+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:18.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:18.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:18.569 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:18.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:19.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:19.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:19.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:19.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:20.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:20.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:20.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:20.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:21.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:21.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:21.590 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:21.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:22.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:22.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:22.633 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:22.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:23.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:23.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:23.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:23.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:24.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:24.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:24.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:24.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:25.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:25.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:25.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:25.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:26.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:26.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:26.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:26.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:27.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:27.037+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:27.543 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:27.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:28.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:28.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:28.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:28.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:29.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:29.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:29.547 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:29.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:30.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:30.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:30.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:30.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:31.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:31.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:31.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:31.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:32.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:32.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:32.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:32.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:33.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:33.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:33.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:33.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:34.168 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:34.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:34.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:34.509+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:35.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:35.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:35.506 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:35.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:36.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:36.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:36.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:36.481+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:37.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:37.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:37.498 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:37.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:38.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:38.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:38.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:38.453+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:39.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:39.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:39.504 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:39.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:40.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:40.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:40.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:40.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:41.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:41.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:41.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:41.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:42.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:42.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:42.564 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:42.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:43.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:43.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:43.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:43.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:44.077 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:44.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:44.612 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:44.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:45.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:45.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:45.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:45.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:46.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:46.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:46.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:46.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:47.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:47.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:47.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:47.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:48.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:48.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:48.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:48.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:49.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:49.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:49.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:49.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:50.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:50.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:50.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:50.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:51.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:51.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:51.623 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:51.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:52.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:52.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:52.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:52.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:53.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:53.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:53.660 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:53.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:54.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:54.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:54.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:54.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:55.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:55.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:55.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:55.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:56.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:56.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:56.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:56.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:57.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:57.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:57.761 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:57.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:58.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:58.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:58.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:58.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:59.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:00:59.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:00:59.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:00:59.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:00.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:00.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:00.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:00.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:01.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:01.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:01.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:01.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:02.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:02.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:02.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:02.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:03.136 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:03.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:03.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:03.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:04.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:04.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:04.799 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:04.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:05.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:05.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:05.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:05.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:06.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:06.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:06.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:06.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:07.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:07.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:07.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:07.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:07.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:07.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:08.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:08.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:09.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:09.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:09.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:09.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:09.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:09.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:10.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:10.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:11.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:11.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:11.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:11.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:12.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:12.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:12.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:12.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:13.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:13.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:13.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:13.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:14.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:14.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:14.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:14.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:15.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:15.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:15.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:15.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:16.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:16.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:16.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:16.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:17.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:17.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:17.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:17.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:18.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:18.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:18.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:18.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:19.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:19.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:19.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:19.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:19.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:19.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:20.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:20.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:21.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:21.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:21.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:21.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:22.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:22.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:22.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:22.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:23.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:23.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:23.560 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:23.556+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:24.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:24.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:24.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:24.516+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:25.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:25.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:25.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:25.540+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:26.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:26.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:26.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:26.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:26.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:26.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:27.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:27.512+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:28.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:28.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:28.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:28.472+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:28.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:28.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:29.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:29.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:30.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:30.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:30.514 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:30.512+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:31.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:31.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:31.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:31.500+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:32.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:32.032+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:32.485 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:32.480+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:32.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:32.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:33.495 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:33.492+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:33.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:33.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:34.536 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:34.532+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:35.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:34.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:35.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:35.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:35.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:35.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:36.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:36.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:36.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:36.952+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:37.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:37.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:37.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:37.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:38.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:38.624+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:38.905 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:38.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:39.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:39.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:39.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:39.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:40.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:40.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:40.904 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:40.900+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:41.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:41.664+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:41.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:41.884+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:42.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:42.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:42.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:42.888+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:43.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:43.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:43.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:43.920+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:44.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:44.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:44.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:44.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:45.684 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:45.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:45.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:45.924+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:46.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:46.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:46.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:46.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:47.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:47.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:47.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:47.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:48.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:48.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:48.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:48.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:49.769 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:49.764+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:49.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:49.932+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:50.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:50.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:50.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:50.972+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:51.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:51.816+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:51.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:51.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:52.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:52.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:52.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:52.952+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:53.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:53.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:53.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:53.976+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:54.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:54.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:54.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:54.992+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:55.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:55.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:55.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:55.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:56.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:56.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:56.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:56.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:57.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:57.764+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:57.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:57.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:58.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:58.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:58.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:58.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:59.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:01:59.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:01:59.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:01:59.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:00.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:00.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:00.962 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:00.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:01.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:01.735+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:01.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:01.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:02.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:02.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:02.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:02.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:03.746 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:03.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:03.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:03.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:04.770 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:04.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:04.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:04.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:05.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:05.735+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:05.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:05.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:06.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:06.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:06.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:06.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:07.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:07.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:07.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:07.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:08.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:08.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:08.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:08.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:09.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:09.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:09.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:09.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:10.733 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:10.727+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:10.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:10.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:11.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:11.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:11.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:11.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:12.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:12.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:12.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:12.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:13.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:13.667+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:13.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:13.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:14.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:14.703+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:14.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:14.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:15.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:15.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:15.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:15.847+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:16.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:16.695+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:16.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:16.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:17.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:17.667+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:17.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:17.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:18.658 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:18.655+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:18.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:18.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:19.663 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:19.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:19.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:19.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:20.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:20.643+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:20.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:20.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:21.692 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:21.687+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:21.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:21.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:22.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:22.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:22.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:22.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:23.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:23.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:23.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:23.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:24.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:24.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:24.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:24.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:25.653 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:25.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:25.760 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:25.755+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:26.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:26.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:26.743 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:26.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:27.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:27.671+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:27.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:27.763+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:28.669 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:28.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:28.788 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:28.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:29.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:29.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:29.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:29.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:30.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:30.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:30.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:30.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:31.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:31.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:31.809 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:31.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:32.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:32.635+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:32.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:32.823+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:33.629 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:33.623+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:33.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:33.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:34.651 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:34.647+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:34.766 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:34.763+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:35.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:35.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:35.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:35.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:36.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:36.691+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:36.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:36.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:37.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:37.719+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:37.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:37.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:38.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:38.715+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:38.844 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:38.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:39.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:39.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:39.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:39.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:40.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:40.723+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:40.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:40.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:41.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:41.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:41.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:41.811+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:42.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:42.711+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:42.859 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:42.855+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:43.679 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:43.675+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:43.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:43.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:44.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:44.683+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:44.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:44.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:45.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:45.731+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:45.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:45.827+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:46.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:46.767+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:46.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:46.875+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:47.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:47.771+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:47.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:47.863+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:48.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:48.759+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:48.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:48.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:49.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:49.743+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:49.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:49.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:50.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:50.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:50.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:50.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:51.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:51.763+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:51.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:51.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:52.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:52.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:52.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:52.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:53.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:53.750+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:53.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:53.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:54.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:54.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:54.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:54.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:55.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:55.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:55.924 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:55.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:56.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:56.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:56.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:56.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:57.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:57.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:57.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:57.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:58.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:58.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:58.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:58.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:59.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:02:59.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:02:59.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:02:59.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:00.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:00.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:00.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:00.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:01.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:01.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:01.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:01.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:02.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:02.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:02.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:02.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:03.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:03.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:03.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:03.926+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:04.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:04.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:04.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:04.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:05.759 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:05.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:05.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:05.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:06.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:06.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:06.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:06.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:07.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:07.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:07.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:07.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:08.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:08.694+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:08.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:08.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:09.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:09.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:09.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:09.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:10.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:10.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:10.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:10.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:11.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:11.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:11.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:11.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:12.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:12.786+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:12.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:12.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:13.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:13.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:13.916 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:13.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:14.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:14.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:14.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:14.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:15.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:15.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:15.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:15.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:16.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:16.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:16.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:16.874+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:17.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:17.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:17.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:17.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:18.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:18.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:18.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:18.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:19.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:19.766+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:19.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:19.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:20.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:20.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:20.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:20.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:21.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:21.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:21.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:21.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:22.777 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:22.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:22.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:22.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:23.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:23.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:23.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:23.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:24.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:24.742+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:24.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:24.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:25.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:25.706+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:25.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:25.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:26.734 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:26.726+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:26.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:26.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:27.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:27.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:27.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:27.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:28.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:28.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:28.780 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:28.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:29.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:29.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:29.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:29.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:30.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:30.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:30.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:30.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:31.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:31.722+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:31.829 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:31.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:32.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:32.754+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:32.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:32.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:33.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:33.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:33.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:33.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:34.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:34.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:34.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:34.782+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:35.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:35.738+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:35.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:35.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:36.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:36.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:36.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:36.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:37.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:37.710+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:37.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:37.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:38.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:38.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:38.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:38.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:39.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:39.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:39.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:39.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:40.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:40.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:40.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:40.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:41.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:41.786+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:41.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:41.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:42.764 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:42.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:42.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:42.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:43.779 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:43.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:43.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:43.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:44.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:44.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:44.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:44.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:45.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:45.785+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:45.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:45.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:46.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:46.829+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:46.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:46.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:47.846 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:47.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:47.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:47.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:48.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:48.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:48.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:48.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:49.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:49.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:49.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:49.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:50.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:50.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:50.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:50.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:51.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:51.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:51.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:51.845+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:52.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:52.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:52.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:52.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:53.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:53.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:53.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:53.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:54.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:54.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:54.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:54.849+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:55.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:55.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:55.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:55.881+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:56.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:56.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:56.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:56.849+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:57.815 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:57.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:57.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:57.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:58.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:58.817+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:58.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:58.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:59.816 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:03:59.809+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:03:59.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:03:59.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:00.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:00.837+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:00.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:00.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:01.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:01.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:01.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:01.869+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:02.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:02.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:02.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:02.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:03.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:03.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:03.911 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:03.905+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:04.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:04.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:04.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:04.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:05.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:05.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:05.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:05.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:06.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:06.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:06.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:06.905+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:07.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:07.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:07.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:07.885+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:08.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:08.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:08.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:08.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:09.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:09.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:09.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:09.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:10.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:10.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:10.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:10.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:11.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:11.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:11.892 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:11.885+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:12.734 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:12.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:12.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:12.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:13.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:13.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:13.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:13.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:14.774 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:14.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:14.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:14.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:15.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:15.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:15.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:15.901+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:16.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:16.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:16.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:16.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:17.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:17.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:17.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:17.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:18.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:18.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:18.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:18.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:19.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:19.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:20.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:20.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:20.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:20.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:21.012 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:21.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:21.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:21.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:21.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:21.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:22.723 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:22.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:22.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:22.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:23.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:23.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:24.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:23.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:24.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:24.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:25.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:24.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:25.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:25.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:26.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:26.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:26.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:26.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:27.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:27.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:27.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:27.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:28.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:28.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:28.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:28.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:29.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:29.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:29.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:29.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:30.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:30.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:30.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:30.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:31.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:31.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:31.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:31.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:32.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:32.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:32.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:32.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:33.034 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:33.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:33.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:33.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:34.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:34.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:34.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:34.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:35.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:35.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:35.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:35.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:36.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:36.101+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:36.755 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:36.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:37.111 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:37.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:37.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:37.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:38.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:38.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:38.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:38.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:39.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:39.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:39.884 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:39.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:40.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:40.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:40.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:40.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:41.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:41.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:41.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:41.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:42.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:42.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:42.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:42.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:43.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:43.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:43.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:43.884+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:44.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:44.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:44.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:44.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:45.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:45.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:45.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:45.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:46.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:46.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:46.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:46.852+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:47.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:47.252+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:47.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:47.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:48.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:48.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:48.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:48.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:49.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:49.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:49.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:49.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:50.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:50.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:50.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:50.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:51.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:51.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:51.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:51.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:52.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:52.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:52.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:52.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:53.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:53.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:53.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:53.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:54.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:54.148+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:54.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:54.800+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:55.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:55.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:55.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:55.836+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:56.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:56.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:56.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:56.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:57.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:57.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:57.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:57.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:58.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:58.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:58.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:58.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:59.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:04:59.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:04:59.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:04:59.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:00.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:00.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:00.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:00.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:01.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:01.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:01.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:01.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:02.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:02.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:02.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:02.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:03.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:03.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:03.905 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:03.900+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:04.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:04.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:04.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:04.856+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:05.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:05.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:05.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:05.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:06.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:06.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:06.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:06.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:07.244 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:07.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:07.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:07.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:08.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:08.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:08.974 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:08.972+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:09.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:09.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:10.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:10.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:10.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:10.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:11.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:11.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:11.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:11.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:12.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:12.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:12.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:12.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:13.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:13.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:13.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:13.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:14.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:14.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:14.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:14.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:15.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:15.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:15.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:15.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:16.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:16.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:16.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:16.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:17.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:17.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:17.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:17.104+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:18.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:18.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:18.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:18.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:19.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:19.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:19.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:19.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:20.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:20.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:20.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:20.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:21.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:21.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:21.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:21.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:22.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:22.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:22.233 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:22.228+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:23.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:23.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:23.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:23.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:24.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:24.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:24.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:24.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:25.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:25.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:25.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:25.244+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:26.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:26.112+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:26.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:26.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:27.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:27.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:27.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:27.236+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:28.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:28.128+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:28.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:28.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:29.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:29.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:29.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:29.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:30.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:30.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:30.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:30.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:31.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:31.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:31.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:31.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:32.156 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:32.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:32.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:32.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:33.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:33.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:33.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:33.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:34.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:34.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:34.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:34.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:35.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:35.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:35.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:35.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:36.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:36.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:36.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:36.179+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:37.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:37.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:37.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:37.175+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:38.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:38.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:38.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:38.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:39.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:39.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:39.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:39.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:40.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:40.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:40.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:40.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:41.019 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:41.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:41.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:41.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:42.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:42.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:42.252 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:42.247+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:43.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:43.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:43.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:43.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:44.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:44.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:44.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:44.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:45.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:45.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:45.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:45.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:46.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:46.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:46.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:46.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:47.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:47.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:47.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:47.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:48.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:48.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:48.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:48.279+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:49.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:49.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:49.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:49.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:50.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:50.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:50.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:50.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:51.116 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:51.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:51.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:51.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:52.082 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:52.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:52.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:52.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:53.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:53.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:53.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:53.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:54.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:54.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:54.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:54.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:55.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:55.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:55.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:55.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:56.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:56.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:56.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:56.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:57.161 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:57.155+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:57.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:57.295+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:58.203 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:58.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:58.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:58.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:59.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:05:59.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:05:59.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:05:59.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:00.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:00.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:00.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:00.287+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:01.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:01.155+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:01.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:01.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:02.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:02.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:02.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:02.375+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:03.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:03.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:03.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:03.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:04.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:04.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:04.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:04.391+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:05.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:05.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:05.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:05.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:06.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:06.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:06.377 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:06.371+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:07.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:07.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:07.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:07.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:08.166 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:08.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:08.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:08.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:09.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:09.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:09.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:09.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:10.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:10.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:10.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:10.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:11.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:11.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:11.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:11.455+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:12.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:12.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:12.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:12.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:13.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:13.155+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:13.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:13.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:14.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:14.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:14.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:14.463+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:15.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:15.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:15.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:15.419+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:16.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:16.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:16.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:16.471+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:17.182 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:17.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:17.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:17.487+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:18.217 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:18.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:18.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:18.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:19.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:19.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:19.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:19.427+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:20.228 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:20.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:20.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:20.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:21.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:21.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:21.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:21.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:22.239 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:22.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:22.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:22.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:23.195 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:23.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:23.523 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:23.519+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:24.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:24.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:24.523 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:24.518+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:25.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:25.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:25.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:25.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:26.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:26.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:26.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:26.590+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:27.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:27.062+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:27.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:27.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:28.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:28.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:28.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:28.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:29.121 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:29.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:29.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:29.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:30.102 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:30.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:30.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:30.650+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:31.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:31.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:31.676 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:31.670+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:32.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:32.086+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:32.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:32.674+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:33.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:33.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:33.727 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:33.722+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:34.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:34.098+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:34.775 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:34.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:35.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:35.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:35.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:35.774+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:36.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:36.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:36.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:36.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:37.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:37.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:37.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:37.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:38.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:38.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:38.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:38.806+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:39.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:39.098+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:39.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:39.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:40.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:40.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:40.773 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:40.766+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:41.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:41.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:41.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:41.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:42.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:42.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:42.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:42.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:43.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:43.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:43.776 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:43.770+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:43.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:43.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:44.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:44.746+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:44.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:44.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:45.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:45.730+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:45.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:45.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:46.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:46.782+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:46.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:46.962+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:47.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:47.798+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:47.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:47.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:48.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:48.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:48.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:48.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:49.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:49.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:49.996 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:49.990+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:50.877 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:50.870+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:51.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:51.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:51.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:51.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:52.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:52.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:52.796 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:52.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:53.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:52.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:53.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:53.806+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:54.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:53.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:54.791 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:54.786+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:54.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:54.978+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:55.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:55.794+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:55.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:55.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:56.766 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:56.758+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:56.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:56.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:57.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:57.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:57.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:57.938+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:58.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:58.734+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:58.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:58.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:59.759 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:06:59.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:06:59.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:06:59.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:00.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:00.750+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:00.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:00.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:01.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:01.754+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:01.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:01.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:02.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:02.714+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:02.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:02.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:03.703 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:03.698+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:03.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:03.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:04.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:04.690+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:04.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:04.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:05.741 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:05.734+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:05.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:05.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:06.767 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:06.762+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:06.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:06.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:07.814 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:07.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:07.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:07.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:08.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:08.798+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:08.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:08.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:09.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:09.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:09.889 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:09.882+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:10.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:10.782+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:10.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:10.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:11.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:11.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:11.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:11.898+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:12.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:12.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:12.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:12.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:13.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:13.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:13.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:13.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:14.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:14.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:14.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:14.922+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:15.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:15.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:15.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:15.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:16.833 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:16.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:16.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:16.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:17.847 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:17.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:17.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:17.849+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:18.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:18.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:18.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:18.861+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:19.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:19.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:19.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:19.909+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:20.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:20.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:20.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:20.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:21.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:21.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:21.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:21.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:22.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:22.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:22.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:22.913+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:23.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:23.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:23.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:23.941+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:24.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:24.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:24.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:24.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:25.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:25.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:25.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:25.929+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:26.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:26.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:26.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:26.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:27.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:27.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:27.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:27.953+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:28.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:28.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:28.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:28.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:29.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:29.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:29.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:29.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:30.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:30.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:31.017 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:31.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:31.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:31.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:32.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:31.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:32.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:32.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:33.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:33.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:33.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:33.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:34.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:34.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:34.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:34.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:35.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:35.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:35.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:35.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:36.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:36.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:36.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:36.881+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:37.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:37.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:37.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:37.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:38.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:38.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:38.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:38.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:39.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:39.149+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:39.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:39.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:40.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:40.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:40.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:40.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:41.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:41.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:41.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:41.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:42.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:42.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:42.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:42.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:43.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:43.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:43.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:43.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:44.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:44.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:44.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:44.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:45.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:45.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:45.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:45.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:46.153 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:46.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:46.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:46.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:47.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:47.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:47.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:47.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:48.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:48.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:48.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:48.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:49.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:49.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:49.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:49.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:50.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:50.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:51.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:51.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:51.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:51.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:51.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:51.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:52.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:52.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:52.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:52.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:53.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:53.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:54.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:53.993+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:54.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:54.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:55.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:55.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:55.158 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:55.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:55.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:55.989+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:56.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:56.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:57.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:57.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:57.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:57.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:58.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:58.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:58.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:58.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:58.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:07:58.973+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:07:59.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:07:59.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:00.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:00.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:00.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:00.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:00.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:00.969+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:01.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:01.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:01.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:01.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:02.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:02.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:03.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:03.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:03.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:03.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:04.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:04.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:04.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:04.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:05.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:05.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:05.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:05.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:06.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:06.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:06.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:06.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:07.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:07.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:07.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:07.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:08.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:08.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:08.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:08.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:09.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:09.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:09.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:09.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:10.129 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:10.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:10.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:10.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:11.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:11.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:11.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:11.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:12.126 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:12.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:12.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:12.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:13.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:13.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:13.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:13.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:14.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:14.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:14.355 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:14.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:15.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:15.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:15.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:15.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:16.038 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:16.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:16.370 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:16.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:16.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:16.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:17.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:17.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:18.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:18.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:18.384 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:18.380+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:19.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:19.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:19.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:19.412+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:20.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:20.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:20.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:20.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:21.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:21.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:21.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:21.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:21.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:21.984+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:22.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:22.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:22.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:22.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:23.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:23.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:23.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:23.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:24.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:24.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:24.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:24.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:25.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:25.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:26.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:26.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:26.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:26.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:27.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:27.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:27.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:27.392+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:28.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:28.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:28.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:28.388+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:28.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:28.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:29.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:29.360+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:29.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:29.940+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:30.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:30.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:30.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:30.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:31.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:31.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:31.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:31.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:32.466 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:32.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:32.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:32.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:33.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:33.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:33.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:33.868+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:34.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:34.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:34.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:34.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:35.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:35.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:35.832 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:35.828+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:36.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:36.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:36.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:36.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:37.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:37.412+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:37.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:37.780+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:38.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:38.400+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:38.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:38.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:39.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:39.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:39.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:39.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:40.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:40.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:40.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:40.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:41.519 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:41.516+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:41.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:41.700+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:42.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:42.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:42.741 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:42.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:43.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:43.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:43.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:43.772+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:44.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:44.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:44.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:44.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:45.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:45.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:45.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:45.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:46.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:46.424+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:46.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:46.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:47.472 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:47.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:47.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:47.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:48.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:48.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:48.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:48.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:49.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:49.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:49.736 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:49.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:50.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:50.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:50.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:50.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:51.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:51.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:51.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:51.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:52.538 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:52.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:52.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:52.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:53.532 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:53.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:53.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:53.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:54.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:54.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:54.801 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:54.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:55.583 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:55.580+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:55.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:55.780+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:56.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:56.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:56.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:56.764+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:57.596 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:57.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:57.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:57.804+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:58.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:58.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:58.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:58.816+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:59.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:08:59.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:08:59.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:08:59.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:00.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:00.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:00.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:00.868+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:01.640 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:01.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:01.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:01.884+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:02.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:02.619+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:02.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:02.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:03.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:03.583+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:03.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:03.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:04.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:04.591+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:04.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:04.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:05.614 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:05.607+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:05.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:05.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:06.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:06.627+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:06.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:06.883+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:07.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:07.639+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:07.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:07.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:08.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:08.651+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:08.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:08.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:09.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:09.687+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:09.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:09.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:10.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:10.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:10.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:10.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:11.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:11.667+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:11.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:11.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:12.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:12.643+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:12.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:12.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:13.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:13.679+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:13.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:13.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:14.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:14.651+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:14.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:14.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:15.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:15.639+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:16.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:15.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:16.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:16.619+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:17.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:16.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:17.637 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:17.631+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:18.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:18.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:18.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:18.651+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:18.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:18.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:19.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:19.663+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:20.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:20.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:20.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:20.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:20.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:20.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:21.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:21.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:21.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:21.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:22.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:22.711+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:22.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:22.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:23.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:23.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:23.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:23.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:24.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:24.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:24.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:24.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:25.757 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:25.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:25.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:25.983+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:26.712 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:26.707+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:26.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:26.983+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:27.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:27.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:28.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:28.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:28.670 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:28.667+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:29.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:29.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:29.630 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:29.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:30.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:30.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:30.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:30.655+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:31.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:31.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:31.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:31.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:32.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:32.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:32.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:32.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:33.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:33.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:33.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:33.707+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:34.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:34.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:34.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:34.731+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:35.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:35.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:35.756 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:35.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:36.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:36.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:36.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:36.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:36.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:36.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:37.787 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:37.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:37.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:37.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:38.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:38.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:38.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:38.951+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:39.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:39.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:39.979 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:39.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:40.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:40.815+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:41.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:41.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:41.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:41.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:41.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:41.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:42.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:42.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:43.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:43.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:43.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:43.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:44.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:44.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:44.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:44.823+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:45.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:45.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:45.824 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:45.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:46.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:46.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:46.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:46.815+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:47.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:47.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:47.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:47.823+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:48.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:48.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:48.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:48.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:49.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:49.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:49.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:49.783+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:50.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:50.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:50.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:50.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:51.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:51.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:51.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:51.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:52.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:52.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:52.851 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:52.847+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:53.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:53.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:53.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:53.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:54.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:54.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:54.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:54.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:55.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:55.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:55.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:55.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:56.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:56.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:56.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:56.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:57.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:57.058+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:57.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:57.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:58.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:58.070+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:58.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:58.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:59.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:09:59.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:09:59.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:09:59.786+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:00.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:00.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:00.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:00.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:01.145 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:01.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:01.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:01.778+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:02.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:02.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:02.794 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:02.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:03.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:03.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:03.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:03.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:04.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:04.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:04.821 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:04.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:05.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:05.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:05.844 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:05.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:06.211 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:06.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:06.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:06.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:07.246 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:07.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:07.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:07.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:08.206 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:08.198+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:08.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:08.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:09.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:09.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:09.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:09.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:10.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:10.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:10.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:10.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:11.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:11.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:11.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:11.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:12.134 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:12.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:12.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:12.810+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:13.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:13.098+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:13.807 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:13.802+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:14.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:14.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:14.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:14.842+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:15.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:15.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:15.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:15.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:16.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:16.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:16.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:16.894+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:17.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:17.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:17.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:17.854+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:18.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:18.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:18.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:18.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:19.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:19.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:19.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:19.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:20.052 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:20.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:20.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:20.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:21.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:21.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:21.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:21.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:22.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:22.006+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:22.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:22.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:23.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:23.002+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:23.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:23.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:23.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:23.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:24.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:24.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:25.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:25.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:25.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:25.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:26.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:26.026+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:26.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:26.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:27.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:27.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:27.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:27.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:27.998 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:27.990+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:28.866 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:28.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:29.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:28.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:29.818 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:29.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:29.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:29.962+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:30.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:30.818+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:30.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:30.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:31.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:31.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:32.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:32.002+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:32.812 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:32.806+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:33.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:33.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:33.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:33.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:34.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:34.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:34.858 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:34.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:34.986 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:34.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:35.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:35.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:35.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:35.978+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:36.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:36.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:36.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:36.938+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:37.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:37.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:37.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:37.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:38.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:38.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:38.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:38.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:39.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:39.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:39.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:39.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:40.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:40.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:40.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:40.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:41.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:41.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:41.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:41.894+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:42.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:42.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:42.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:42.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:43.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:43.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:43.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:43.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:44.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:44.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:44.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:44.926+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:45.825 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:45.818+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:45.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:45.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:46.859 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:46.853+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:46.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:46.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:47.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:47.873+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:47.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:47.961+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:48.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:48.825+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:49.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:49.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:49.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:49.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:50.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:50.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:50.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:50.841+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:51.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:51.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:51.874 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:51.865+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:52.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:52.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:52.826 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:52.821+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:53.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:53.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:53.861 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:53.853+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:54.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:54.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:54.883 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:54.877+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:55.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:55.113+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:55.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:55.885+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:56.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:56.105+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:56.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:56.901+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:57.131 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:57.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:57.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:57.857+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:58.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:58.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:58.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:58.889+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:59.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:10:59.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:10:59.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:10:59.937+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:00.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:00.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:00.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:00.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:01.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:01.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:01.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:01.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:02.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:02.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:02.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:02.901+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:03.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:03.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:03.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:03.937+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:03.991 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:03.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:04.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:04.921+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:05.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:05.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:05.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:05.933+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:06.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:06.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:06.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:06.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:07.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:07.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:07.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:07.945+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:08.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:08.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:08.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:08.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:09.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:09.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:10.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:09.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:10.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:10.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:10.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:10.969+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:11.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:11.045+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:12.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:12.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:12.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:12.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:13.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:13.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:13.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:13.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:14.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:14.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:14.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:14.057+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:15.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:14.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:15.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:15.033+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:15.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:15.949+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:15.993 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:15.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:16.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:16.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:17.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:17.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:18.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:18.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:18.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:18.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:19.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:19.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:19.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:19.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:20.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:20.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:20.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:20.173+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:21.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:21.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:21.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:21.181+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:22.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:22.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:22.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:22.213+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:23.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:23.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:23.250 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:23.241+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:24.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:24.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:24.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:24.209+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:25.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:25.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:25.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:25.165+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:25.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:25.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:26.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:26.133+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:27.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:27.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:27.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:27.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:27.987 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:27.981+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:28.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:28.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:29.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:29.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:29.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:29.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:30.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:30.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:30.053 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:30.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:31.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:31.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:31.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:31.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:32.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:32.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:32.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:32.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:33.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:33.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:33.118 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:33.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:34.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:34.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:34.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:34.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:35.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:35.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:35.099 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:35.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:36.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:36.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:36.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:36.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:37.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:37.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:37.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:37.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:38.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:38.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:38.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:38.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:39.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:39.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:39.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:39.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:40.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:40.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:40.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:40.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:41.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:41.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:41.175 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:41.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:42.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:42.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:42.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:42.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:43.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:43.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:43.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:43.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:44.186 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:44.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:44.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:44.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:45.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:45.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:45.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:45.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:46.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:46.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:46.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:46.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:47.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:47.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:47.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:47.192+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:48.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:48.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:48.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:48.240+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:49.165 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:49.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:49.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:49.272+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:50.141 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:50.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:50.263 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:50.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:51.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:51.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:51.298 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:51.292+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:52.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:52.136+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:52.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:52.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:53.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:53.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:53.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:53.344+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:54.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:54.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:54.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:54.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:55.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:55.076+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:55.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:55.416+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:56.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:56.076+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:56.384 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:56.380+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:57.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:57.096+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:57.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:57.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:58.090 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:58.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:58.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:58.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:59.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:11:59.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:11:59.339 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:11:59.336+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:00.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:00.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:00.335 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:00.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:01.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:01.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:01.333 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:01.328+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:02.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:02.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:02.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:02.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:03.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:03.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:03.389 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:03.384+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:04.056 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:04.052+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:04.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:04.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:05.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:05.064+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:05.397 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:05.392+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:06.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:06.024+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:06.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:06.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:07.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:07.020+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:07.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:07.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:08.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:07.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:08.443 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:08.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:09.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:09.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:09.403 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:09.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:09.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:09.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:10.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:10.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:10.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:10.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:11.445 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:11.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:12.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:12.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:12.466 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:12.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:13.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:13.028+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:13.444 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:13.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:14.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:14.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:14.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:14.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:15.058 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:15.056+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:15.446 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:15.440+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:16.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:16.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:16.470 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:16.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:17.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:17.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:17.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:17.508+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:17.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:17.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:18.530 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:18.524+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:18.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:18.956+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:19.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:19.576+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:19.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:19.916+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:20.589 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:20.584+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:20.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:20.888+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:21.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:21.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:21.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:21.864+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:22.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:22.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:22.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:22.880+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:23.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:23.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:23.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:23.836+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:24.701 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:24.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:24.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:24.868+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:25.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:25.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:25.824 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:25.820+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:26.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:26.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:26.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:26.832+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:27.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:27.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:27.801 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:27.796+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:28.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:28.788+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:28.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:28.792+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:29.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:29.796+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:29.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:29.840+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:30.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:30.800+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:30.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:30.808+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:31.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:31.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:31.837 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:31.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:32.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:32.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:32.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:32.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:33.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:33.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:33.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:33.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:34.813 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:34.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:34.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:34.879+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:35.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:35.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:35.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:35.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:36.831 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:36.827+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:36.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:36.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:37.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:37.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:37.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:37.867+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:38.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:38.883+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:38.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:38.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:39.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:39.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:39.926 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:39.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:40.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:40.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:40.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:40.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:41.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:41.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:41.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:41.879+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:42.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:42.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:42.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:42.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:43.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:43.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:43.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:43.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:44.903 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:44.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:44.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:44.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:45.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:45.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:45.927 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:45.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:46.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:46.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:46.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:46.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:47.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:47.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:47.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:47.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:48.910 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:48.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:48.983 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:48.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:49.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:49.859+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:49.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:49.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:50.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:50.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:50.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:50.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:51.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:51.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:51.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:51.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:52.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:52.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:52.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:52.979+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:53.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:53.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:53.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:53.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:54.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:54.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:54.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:54.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:55.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:55.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:55.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:55.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:56.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:56.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:56.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:56.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:57.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:57.879+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:57.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:57.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:58.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:58.835+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:58.994 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:58.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:59.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:12:59.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:12:59.949 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:12:59.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:00.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:00.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:00.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:00.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:01.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:01.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:01.963 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:01.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:02.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:02.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:02.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:02.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:03.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:03.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:03.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:03.967+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:04.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:04.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:04.936 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:04.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:05.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:05.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:05.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:05.923+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:06.882 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:06.879+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:06.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:06.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:07.918 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:07.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:07.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:07.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:08.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:08.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:08.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:08.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:09.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:09.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:09.960 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:09.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:10.920 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:10.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:10.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:10.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:11.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:11.883+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:11.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:11.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:12.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:12.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:12.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:12.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:13.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:13.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:13.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:13.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:14.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:14.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:14.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:14.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:15.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:15.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:15.930 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:15.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:16.931 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:16.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:16.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:16.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:17.956 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:17.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:17.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:17.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:18.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:18.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:18.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:18.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:19.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:19.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:19.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:19.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:20.903 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:20.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:20.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:20.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:21.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:21.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:21.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:21.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:22.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:22.859+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:22.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:22.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:23.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:23.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:23.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:23.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:24.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:24.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:24.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:24.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:25.825 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:25.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:25.971 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:25.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:26.813 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:26.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:26.973 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:26.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:27.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:27.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:28.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:28.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:28.868 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:28.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:29.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:29.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:29.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:29.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:30.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:29.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:30.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:30.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:31.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:31.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:31.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:31.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:32.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:31.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:32.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:32.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:32.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:32.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:33.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:33.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:33.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:33.990+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:34.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:34.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:35.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:34.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:35.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:35.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:35.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:35.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:36.864 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:36.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:36.950 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:36.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:37.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:37.838+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:37.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:37.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:38.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:38.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:38.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:38.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:39.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:39.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:39.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:39.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:40.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:40.818+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:40.834 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:40.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:41.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:41.842+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:41.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:41.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:42.843 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:42.838+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:42.918 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:42.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:43.894 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:43.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:43.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:43.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:44.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:44.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:44.902 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:44.898+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:45.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:45.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:45.919 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:45.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:46.881 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:46.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:46.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:46.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:47.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:47.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:47.938 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:47.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:48.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:48.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:48.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:48.962+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:49.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:49.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:50.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:49.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:50.923 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:50.918+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:50.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:50.990+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:51.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:51.870+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:52.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:52.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:52.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:52.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:53.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:53.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:53.888 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:53.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:54.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:54.026+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:54.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:54.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:54.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:54.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:55.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:55.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:55.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:55.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:56.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:56.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:56.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:56.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:57.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:57.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:57.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:57.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:58.839 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:58.834+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:58.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:58.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:59.820 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:13:59.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:13:59.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:13:59.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:00.835 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:00.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:00.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:00.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:01.864 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:01.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:01.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:01.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:02.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:02.870+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:02.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:02.898+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:03.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:03.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:03.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:03.854+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:04.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:04.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:04.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:04.894+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:05.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:05.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:05.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:05.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:06.829 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:06.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:06.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:06.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:07.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:07.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:07.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:07.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:08.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:08.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:09.005 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:08.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:09.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:09.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:10.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:10.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:10.831 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:10.826+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:11.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:10.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:11.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:11.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:12.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:11.998+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:12.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:12.830+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:13.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:13.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:13.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:13.878+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:14.032 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:14.026+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:14.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:14.830+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:15.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:15.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:15.811 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:15.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:16.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:16.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:16.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:16.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:17.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:17.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:17.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:17.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:18.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:18.177+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:18.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:18.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:19.139 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:19.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:19.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:19.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:20.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:20.161+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:20.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:20.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:21.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:21.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:21.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:21.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:22.140 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:22.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:22.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:22.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:23.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:23.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:23.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:23.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:24.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:24.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:24.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:24.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:25.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:25.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:25.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:25.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:26.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:26.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:26.798 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:26.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:27.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:27.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:27.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:27.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:28.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:28.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:28.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:28.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:29.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:29.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:29.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:29.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:30.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:30.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:30.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:30.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:31.213 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:31.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:31.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:31.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:32.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:32.193+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:32.768 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:32.761+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:33.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:33.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:33.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:33.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:34.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:34.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:34.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:34.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:35.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:35.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:35.817 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:35.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:36.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:36.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:36.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:36.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:37.278 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:37.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:37.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:37.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:38.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:38.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:38.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:38.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:39.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:39.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:39.697 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:39.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:40.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:40.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:40.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:40.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:41.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:41.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:41.626 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:41.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:42.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:42.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:42.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:42.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:43.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:43.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:43.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:43.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:44.318 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:44.313+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:44.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:44.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:45.327 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:45.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:45.722 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:45.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:46.369 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:46.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:46.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:46.689+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:47.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:47.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:47.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:47.709+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:48.383 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:48.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:48.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:48.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:49.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:49.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:49.763 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:49.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:50.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:50.365+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:50.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:50.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:51.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:51.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:51.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:51.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:52.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:52.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:52.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:52.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:53.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:53.389+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:53.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:53.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:54.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:54.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:54.806 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:54.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:55.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:55.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:55.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:55.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:56.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:56.465+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:56.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:56.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:57.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:57.517+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:57.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:57.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:58.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:58.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:58.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:58.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:59.447 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:14:59.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:14:59.758 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:14:59.753+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:00.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:00.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:00.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:00.709+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:01.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:01.425+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:01.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:01.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:02.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:02.385+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:02.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:02.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:03.378 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:03.373+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:03.652 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:03.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:04.356 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:04.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:04.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:04.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:05.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:05.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:05.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:05.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:06.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:06.437+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:06.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:06.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:07.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:07.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:07.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:07.616+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:08.440 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:08.436+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:08.654 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:08.648+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:09.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:09.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:09.676 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:09.672+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:10.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:10.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:10.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:10.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:11.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:11.524+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:11.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:11.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:12.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:12.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:12.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:12.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:13.593 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:13.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:13.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:13.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:14.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:14.612+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:14.686 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:14.680+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:15.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:15.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:15.716 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:15.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:16.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:16.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:16.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:16.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:17.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:17.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:17.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:17.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:18.618 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:18.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:18.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:18.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:19.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:19.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:19.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:19.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:20.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:20.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:20.749 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:20.744+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:21.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:21.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:21.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:21.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:22.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:22.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:22.753 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:22.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:23.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:23.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:23.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:23.776+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:24.739 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:24.736+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:24.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:24.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:25.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:25.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:25.818 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:25.812+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:26.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:26.728+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:26.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:26.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:27.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:27.764+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:27.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:27.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:28.785 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:28.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:28.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:28.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:29.750 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:29.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:29.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:29.816+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:30.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:30.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:30.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:30.844+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:31.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:31.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:31.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:31.880+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:32.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:32.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:32.870 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:32.864+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:33.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:33.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:33.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:33.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:34.683 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:34.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:34.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:34.904+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:35.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:35.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:35.886 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:35.884+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:36.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:36.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:36.937 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:36.932+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:37.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:37.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:37.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:37.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:38.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:38.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:39.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:39.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:39.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:39.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:40.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:40.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:40.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:40.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:41.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:41.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:41.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:41.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:42.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:42.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:42.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:42.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:43.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:43.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:43.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:43.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:44.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:44.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:44.717 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:44.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:45.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:45.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:45.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:45.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:46.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:46.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:46.659 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:46.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:47.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:47.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:47.651 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:47.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:48.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:48.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:48.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:48.652+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:49.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:49.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:49.614 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:49.608+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:50.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:50.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:50.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:50.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:51.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:51.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:51.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:51.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:52.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:52.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:52.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:52.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:53.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:53.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:53.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:53.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:54.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:54.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:54.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:54.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:55.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:55.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:55.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:55.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:55.992 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:55.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:56.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:56.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:56.995 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:56.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:57.771 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:57.768+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:58.036 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:58.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:58.810 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:58.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:59.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:59.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:15:59.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:15:59.763+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:00.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:15:59.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:00.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:00.803+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:01.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:00.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:01.845 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:01.839+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:01.999 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:01.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:02.870 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:02.863+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:03.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:02.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:03.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:03.879+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:03.984 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:03.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:04.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:04.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:04.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:04.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:05.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:05.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:06.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:06.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:06.948 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:06.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:06.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:06.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:07.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:07.935+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:07.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:07.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:08.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:08.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:08.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:08.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:09.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:09.987+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:09.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:09.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:10.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:10.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:10.986 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:10.983+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:11.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:11.943+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:11.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:11.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:12.901 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:12.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:12.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:12.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:13.908 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:13.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:13.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:13.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:14.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:14.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:14.942 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:14.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:15.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:15.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:15.896 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:15.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:16.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:16.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:16.906 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:16.899+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:17.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:17.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:17.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:17.887+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:18.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:18.791+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:18.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:18.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:19.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:19.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:19.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:19.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:20.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:20.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:20.992 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:20.987+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:21.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:21.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:22.004 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:21.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:22.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:22.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:23.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:23.011+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:23.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:23.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:24.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:24.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:24.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:24.875+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:24.995 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:24.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:25.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:25.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:26.024 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:26.019+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:26.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:26.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:27.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:27.039+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:27.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:27.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:28.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:28.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:28.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:28.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:29.105 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:29.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:29.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:29.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:30.084 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:30.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:30.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:30.811+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:31.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:31.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:31.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:31.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:32.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:32.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:32.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:32.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:33.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:33.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:33.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:33.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:34.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:34.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:34.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:34.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:35.208 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:35.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:35.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:35.839+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:36.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:36.175+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:36.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:36.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:37.143 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:37.139+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:37.814 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:37.807+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:38.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:38.171+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:38.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:38.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:39.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:39.219+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:39.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:39.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:40.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:40.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:40.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:40.779+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:41.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:41.263+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:41.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:41.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:42.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:42.283+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:42.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:42.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:43.321 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:43.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:43.848 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:43.843+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:44.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:44.327+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:44.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:44.831+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:45.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:45.347+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:45.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:45.863+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:46.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:46.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:46.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:46.899+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:47.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:47.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:47.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:47.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:48.367 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:48.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:48.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:48.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:49.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:49.355+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:49.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:49.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:50.365 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:50.359+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:50.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:50.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:51.339 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:51.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:51.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:51.918+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:52.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:52.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:52.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:52.966+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:53.361 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:53.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:54.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:53.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:54.371 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:54.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:55.049 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:55.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:55.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:55.410+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:56.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:56.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:56.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:56.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:57.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:57.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:57.496 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:57.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:58.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:58.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:58.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:58.498+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:58.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:58.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:59.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:16:59.550+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:16:59.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:16:59.946+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:00.180 INFO:tasks.workunit.client.0.smithi137.stderr:2024-09-16T14:17:00.174+0000 7f6111ffb700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh (PID: 26297) UID: 1000 2024-09-16T14:17:00.181 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-16T14:17:00.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:00.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:00.906 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:00.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:01.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:01.558+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:01.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:01.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:02.551 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:02.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:02.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:02.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:03.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:03.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:03.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:03.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:04.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:04.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:04.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:04.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:05.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:05.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:06.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:06.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:06.509 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:06.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:06.976 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:06.970+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:07.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:07.522+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:07.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:07.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:08.507 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:08.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:08.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:08.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:09.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:09.530+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:09.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:09.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:10.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:10.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:10.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:10.958+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:11.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:11.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:11.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:11.974+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:12.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:12.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:12.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:12.938+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:13.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:13.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:13.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:13.894+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:14.413 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:14.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:14.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:14.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:15.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:15.458+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:15.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:15.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:16.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:16.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:16.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:16.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:17.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:17.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:17.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:17.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:18.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:18.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:18.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:18.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:19.395 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:19.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:19.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:19.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:20.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:20.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:20.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:20.934+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:21.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:21.382+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:21.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:21.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:22.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:22.410+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:22.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:22.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:23.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:23.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:23.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:23.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:24.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:24.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:24.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:24.914+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:25.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:25.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:25.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:25.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:26.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:26.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:26.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:26.858+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:27.354 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:27.350+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:27.821 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:27.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:28.315 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:28.310+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:28.815 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:28.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:29.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:29.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:29.781 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:29.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:30.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:30.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:30.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:30.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:31.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:31.326+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:31.776 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:31.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:32.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:32.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:32.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:32.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:33.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:33.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:33.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:33.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:34.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:34.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:34.767 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:34.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:35.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:35.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:35.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:35.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:36.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:36.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:36.748 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:36.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:37.256 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:37.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:37.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:37.766+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:38.223 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:38.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:38.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:38.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:39.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:39.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:39.784 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:39.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:40.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:40.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:40.744 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:40.738+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:41.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:41.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:41.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:41.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:42.269 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:42.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:42.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:42.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:43.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:43.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:43.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:43.854+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:44.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:44.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:44.869 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:44.862+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:45.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:45.226+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:45.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:45.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:46.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:46.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:46.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:46.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:47.234 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:47.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:47.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:47.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:48.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:48.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:48.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:48.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:49.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:49.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:49.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:49.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:50.312 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:50.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:50.988 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:50.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:51.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:51.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:52.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:52.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:52.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:52.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:53.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:53.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:53.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:53.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:54.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:54.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:54.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:54.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:55.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:55.025+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:55.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:55.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:56.021 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:56.013+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:56.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:56.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:57.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:57.041+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:57.233 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:57.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:58.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:58.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:58.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:58.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:59.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:17:59.077+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:17:59.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:17:59.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:00.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:00.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:00.181 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-09-16T14:18:00.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:00.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:01.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:01.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:01.307 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:01.301+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:02.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:02.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:02.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:02.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:03.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:03.125+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:03.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:03.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:04.171 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:04.165+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:04.218 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:04.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:05.223 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:05.217+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:05.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:05.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:06.174 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:06.169+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:06.297 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:06.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:07.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:07.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:07.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:07.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:08.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:08.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:08.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:08.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:09.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:09.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:09.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:09.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:10.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:10.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:10.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:10.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:11.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:11.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:11.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:11.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:12.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:12.029+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:12.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:12.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:13.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:13.021+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:13.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:13.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:14.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:14.037+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:14.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:14.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:15.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:15.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:15.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:15.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:16.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:15.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:16.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:16.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:17.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:16.985+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:17.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:17.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:18.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:18.005+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:18.207 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:18.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:19.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:19.001+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:19.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:19.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:20.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:19.997+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:20.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:20.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:20.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:20.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:21.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:21.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:22.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:22.017+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:22.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:22.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:23.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:23.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:23.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:23.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:24.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:24.073+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:24.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:24.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:25.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:25.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:25.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:25.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:26.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:26.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:26.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:26.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:27.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:27.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:27.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:27.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:28.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:28.081+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:28.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:28.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:29.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:29.121+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:29.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:29.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:30.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:30.101+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:30.313 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:30.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:31.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:31.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:31.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:31.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:32.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:32.129+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:32.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:32.345+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:33.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:33.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:33.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:33.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:34.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:34.141+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:34.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:34.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:35.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:35.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:35.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:35.293+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:36.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:36.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:36.262 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:36.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:37.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:37.097+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:37.232 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:37.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:38.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:38.093+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:38.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:38.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:39.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:39.061+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:39.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:39.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:40.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:40.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:40.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:40.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:41.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:41.089+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:41.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:41.204+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:42.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:42.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:42.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:42.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:43.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:43.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:43.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:43.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:44.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:44.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:44.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:44.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:45.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:45.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:45.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:45.208+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:46.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:46.160+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:46.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:46.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:47.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:47.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:47.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:47.216+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:48.215 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:48.212+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:48.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:48.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:49.174 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:49.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:49.288 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:49.284+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:50.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:50.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:50.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:50.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:51.162 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:51.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:51.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:51.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:52.144 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:52.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:52.302 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:52.296+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:53.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:53.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:53.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:53.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:54.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:54.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:54.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:54.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:55.089 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:55.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:55.304 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:55.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:56.121 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:56.116+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:56.344 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:56.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:57.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:57.088+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:57.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:57.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:58.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:58.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:58.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:58.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:59.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:18:59.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:18:59.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:18:59.308+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:00.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:00.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:00.182 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2024-09-16T14:19:00.182 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2024-09-16T14:19:00.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T14:19:00.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:00.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:00.458 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi137 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2024-09-16T14:19:00.678 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=230816f1918c4d51a822c2611b4d8f96 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 126, in task with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi137 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2024-09-16T14:19:00.681 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T14:19:00.690 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-09-16T14:19:00.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:19:00.986 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:19:00.986 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":167,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T12:20:03.062278+0000","last_up_change":"2024-09-16T11:15:47.757879+0000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T11:15:49.622679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T11:15:52.662555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":163,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2024-09-16T11:16:00.008864+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":163,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":20976},{"type":"v1","addr":"172.21.15.137:6801","nonce":20976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":20976},{"type":"v1","addr":"172.21.15.137:6804","nonce":20976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":20976},{"type":"v1","addr":"172.21.15.137:6814","nonce":20976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":20976},{"type":"v1","addr":"172.21.15.137:6809","nonce":20976}]},"public_addr":"172.21.15.137:6801/20976","cluster_addr":"172.21.15.137:6804/20976","heartbeat_back_addr":"172.21.15.137:6814/20976","heartbeat_front_addr":"172.21.15.137:6809/20976","state":["exists","up"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":20975},{"type":"v1","addr":"172.21.15.137:6805","nonce":20975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":20975},{"type":"v1","addr":"172.21.15.137:6808","nonce":20975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":20975},{"type":"v1","addr":"172.21.15.137:6815","nonce":20975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":20975},{"type":"v1","addr":"172.21.15.137:6811","nonce":20975}]},"public_addr":"172.21.15.137:6805/20975","cluster_addr":"172.21.15.137:6808/20975","heartbeat_back_addr":"172.21.15.137:6815/20975","heartbeat_front_addr":"172.21.15.137:6811/20975","state":["exists","up"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":20977},{"type":"v1","addr":"172.21.15.137:6817","nonce":20977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":20977},{"type":"v1","addr":"172.21.15.137:6819","nonce":20977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":20977},{"type":"v1","addr":"172.21.15.137:6823","nonce":20977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":20977},{"type":"v1","addr":"172.21.15.137:6821","nonce":20977}]},"public_addr":"172.21.15.137:6817/20977","cluster_addr":"172.21.15.137:6819/20977","heartbeat_back_addr":"172.21.15.137:6823/20977","heartbeat_front_addr":"172.21.15.137:6821/20977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.716173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.679354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.717390+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:19:01.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T14:19:01.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:19:01.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:01.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:01.282 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:19:01.284 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:19:01.299 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5660,"stamp":"2024-09-16T14:19:00.543236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35016,"ondisk_log_size":35016,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521668,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593852,"statfs":{"total":289910292480,"available":288352104448,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003110"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"163'1580","reported_seq":2605,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106849+0000","last_change":"2024-09-16T11:22:06.765559+0000","last_active":"2024-09-16T12:20:01.106849+0000","last_peered":"2024-09-16T12:20:01.106849+0000","last_clean":"2024-09-16T12:20:01.106849+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T12:20:01.106849+0000","last_undegraded":"2024-09-16T12:20:01.106849+0000","last_fullsized":"2024-09-16T12:20:01.106849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"163'2172","reported_seq":3225,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106663+0000","last_change":"2024-09-16T11:22:06.765623+0000","last_active":"2024-09-16T12:20:01.106663+0000","last_peered":"2024-09-16T12:20:01.106663+0000","last_clean":"2024-09-16T12:20:01.106663+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T12:20:01.106663+0000","last_undegraded":"2024-09-16T12:20:01.106663+0000","last_fullsized":"2024-09-16T12:20:01.106663+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15593,"ondisk_log_size":15593,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533348,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838492,"statfs":{"total":96636764160,"available":96090615808,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.753},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.51500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.751,"15min":0.78400000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.495,"5min":0.46999999999999997,"15min":0.44500000000000001},"max":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.80500000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.54100000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55400000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544984,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826856,"statfs":{"total":96636764160,"available":96078700544,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.41999999999999998},"max":{"1min":0.71699999999999997,"5min":0.751,"15min":0.79600000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.71099999999999997,"5min":0.78000000000000003,"15min":1.1299999999999999},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.94099999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.45900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81699999999999995},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740574,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44500000000000001,"5min":0.442,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.83299999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.83199999999999996},"last":0.748}]},{"osd":2,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":0.749,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.39500000000000002},"max":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.79400000000000004},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:19:01.300 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:19:01.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:01.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:01.585 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:19:01.587 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:19:01.598 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5660,"stamp":"2024-09-16T14:19:00.543236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35016,"ondisk_log_size":35016,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521668,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593852,"statfs":{"total":289910292480,"available":288352104448,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003110"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"163'1580","reported_seq":2605,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106849+0000","last_change":"2024-09-16T11:22:06.765559+0000","last_active":"2024-09-16T12:20:01.106849+0000","last_peered":"2024-09-16T12:20:01.106849+0000","last_clean":"2024-09-16T12:20:01.106849+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T12:20:01.106849+0000","last_undegraded":"2024-09-16T12:20:01.106849+0000","last_fullsized":"2024-09-16T12:20:01.106849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"163'2172","reported_seq":3225,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106663+0000","last_change":"2024-09-16T11:22:06.765623+0000","last_active":"2024-09-16T12:20:01.106663+0000","last_peered":"2024-09-16T12:20:01.106663+0000","last_clean":"2024-09-16T12:20:01.106663+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T12:20:01.106663+0000","last_undegraded":"2024-09-16T12:20:01.106663+0000","last_fullsized":"2024-09-16T12:20:01.106663+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15593,"ondisk_log_size":15593,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533348,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838492,"statfs":{"total":96636764160,"available":96090615808,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.753},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.51500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.751,"15min":0.78400000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.495,"5min":0.46999999999999997,"15min":0.44500000000000001},"max":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.80500000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.54100000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55400000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544984,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826856,"statfs":{"total":96636764160,"available":96078700544,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.41999999999999998},"max":{"1min":0.71699999999999997,"5min":0.751,"15min":0.79600000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.71099999999999997,"5min":0.78000000000000003,"15min":1.1299999999999999},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.94099999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.45900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81699999999999995},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740574,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44500000000000001,"5min":0.442,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.83299999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.83199999999999996},"last":0.748}]},{"osd":2,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":0.749,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.39500000000000002},"max":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.79400000000000004},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:19:01.599 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T14:19:01.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:19:01.880 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:19:01.883 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:19:01.894 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5660,"stamp":"2024-09-16T14:19:00.543236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35016,"ondisk_log_size":35016,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521668,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593852,"statfs":{"total":289910292480,"available":288352104448,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003110"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"163'1580","reported_seq":2605,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106849+0000","last_change":"2024-09-16T11:22:06.765559+0000","last_active":"2024-09-16T12:20:01.106849+0000","last_peered":"2024-09-16T12:20:01.106849+0000","last_clean":"2024-09-16T12:20:01.106849+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T12:20:01.106849+0000","last_undegraded":"2024-09-16T12:20:01.106849+0000","last_fullsized":"2024-09-16T12:20:01.106849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"163'2172","reported_seq":3225,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106663+0000","last_change":"2024-09-16T11:22:06.765623+0000","last_active":"2024-09-16T12:20:01.106663+0000","last_peered":"2024-09-16T12:20:01.106663+0000","last_clean":"2024-09-16T12:20:01.106663+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T12:20:01.106663+0000","last_undegraded":"2024-09-16T12:20:01.106663+0000","last_fullsized":"2024-09-16T12:20:01.106663+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15593,"ondisk_log_size":15593,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533348,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838492,"statfs":{"total":96636764160,"available":96090615808,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.47099999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.70199999999999996,"5min":0.71799999999999997,"15min":0.753},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.51500000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.751,"15min":0.78400000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.495,"5min":0.46999999999999997,"15min":0.44500000000000001},"max":{"1min":0.70599999999999996,"5min":0.78000000000000003,"15min":0.80500000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.54100000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55400000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544984,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826856,"statfs":{"total":96636764160,"available":96078700544,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.41999999999999998},"max":{"1min":0.71699999999999997,"5min":0.751,"15min":0.79600000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.71099999999999997,"5min":0.78000000000000003,"15min":1.1299999999999999},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.42299999999999999},"max":{"1min":0.68400000000000005,"5min":0.755,"15min":0.94099999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.45900000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.81699999999999995},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740574,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.44500000000000001,"5min":0.442,"15min":0.371},"max":{"1min":0.76600000000000001,"5min":0.79400000000000004,"15min":0.83299999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68300000000000005},"min":{"1min":0.59999999999999998,"5min":0.54600000000000004,"15min":0.47399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.83199999999999996},"last":0.748}]},{"osd":2,"last update":"Mon Sep 16 14:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.51100000000000001,"5min":0.45900000000000002,"15min":0.38},"max":{"1min":0.749,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.39500000000000002},"max":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.79400000000000004},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:19:01.895 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:19:02.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:02.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:02.217 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:19:02.217 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":167,"fsid":"29776169-9ac5-45b0-a0e5-5f4309d9b6a8","created":"2024-09-16T11:15:37.358262+0000","modified":"2024-09-16T12:20:03.062278+0000","last_up_change":"2024-09-16T11:15:47.757879+0000","last_in_change":"2024-09-16T11:15:38.199666+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T11:15:49.622679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T11:15:52.662555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":163,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2024-09-16T11:16:00.008864+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"19","last_force_op_resend_prenautilus":"19","last_force_op_resend_preluminous":"19","auid":0,"snap_mode":"selfmanaged","snap_seq":93,"snap_epoch":163,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"5d95f1dd-6d95-4053-849a-d86b0644797f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":20976},{"type":"v1","addr":"172.21.15.137:6801","nonce":20976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":20976},{"type":"v1","addr":"172.21.15.137:6804","nonce":20976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":20976},{"type":"v1","addr":"172.21.15.137:6814","nonce":20976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":20976},{"type":"v1","addr":"172.21.15.137:6809","nonce":20976}]},"public_addr":"172.21.15.137:6801/20976","cluster_addr":"172.21.15.137:6804/20976","heartbeat_back_addr":"172.21.15.137:6814/20976","heartbeat_front_addr":"172.21.15.137:6809/20976","state":["exists","up"]},{"osd":1,"uuid":"cb66ef56-46ea-4662-aaa6-7aeceb0f5b65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":20975},{"type":"v1","addr":"172.21.15.137:6805","nonce":20975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":20975},{"type":"v1","addr":"172.21.15.137:6808","nonce":20975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6813","nonce":20975},{"type":"v1","addr":"172.21.15.137:6815","nonce":20975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":20975},{"type":"v1","addr":"172.21.15.137:6811","nonce":20975}]},"public_addr":"172.21.15.137:6805/20975","cluster_addr":"172.21.15.137:6808/20975","heartbeat_back_addr":"172.21.15.137:6815/20975","heartbeat_front_addr":"172.21.15.137:6811/20975","state":["exists","up"]},{"osd":2,"uuid":"e77353b1-a6fe-4906-b299-7714b0bb6d08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":20977},{"type":"v1","addr":"172.21.15.137:6817","nonce":20977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":20977},{"type":"v1","addr":"172.21.15.137:6819","nonce":20977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6822","nonce":20977},{"type":"v1","addr":"172.21.15.137:6823","nonce":20977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":20977},{"type":"v1","addr":"172.21.15.137:6821","nonce":20977}]},"public_addr":"172.21.15.137:6817/20977","cluster_addr":"172.21.15.137:6819/20977","heartbeat_back_addr":"172.21.15.137:6823/20977","heartbeat_front_addr":"172.21.15.137:6821/20977","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.716173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.679354+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T11:15:43.717390+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:19:02.345 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:02.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:03.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:03.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:03.231 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T14:19:03.232 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:19:03.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:03.304+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:04.088 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:04.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:04.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:04.348+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:05.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:05.080+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:05.326 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:05.324+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:06.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:06.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:06.343 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:06.340+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:07.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:07.120+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:07.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:07.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:08.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:08.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:08.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:08.388+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:09.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:09.100+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:09.366 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:09.364+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:10.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:10.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:10.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:10.396+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:11.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:11.084+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:11.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:11.372+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:12.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:12.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:12.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:12.332+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:13.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:13.004+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:13.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:13.300+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:13.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:13.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:14.290 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:14.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:15.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:15.036+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:15.324 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:15.320+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:16.043 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:16.040+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:16.364 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:16.360+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:17.018 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:17.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:17.405 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:17.400+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:17.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:17.968+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:18.410 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:18.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:18.991 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:18.988+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:19.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:19.436+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:19.988 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:19.984+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:20.447 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:20.444+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:21.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:20.996+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:21.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:21.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:22.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:22.012+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:22.510 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:22.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:23.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:23.008+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:23.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:23.464+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:24.020 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:24.016+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:24.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:24.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:25.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:25.044+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:25.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:25.424+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:26.075 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:26.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:26.411 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:26.408+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:27.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:27.072+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:27.409 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:27.404+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:28.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:28.048+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:28.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:28.420+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:29.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:29.092+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:29.457 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:29.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:30.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:30.140+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:30.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:30.452+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:31.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:31.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:31.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:31.484+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:32.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:32.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:32.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:32.500+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:33.200 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:33.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:33.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:33.520+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:34.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:34.168+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:34.507 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:34.504+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:35.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:35.124+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:35.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:35.548+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:36.094 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:36.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:36.515 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:36.511+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:37.132 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:37.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:37.531 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:37.527+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:38.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:38.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:38.574 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:38.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:39.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:39.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:39.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:39.571+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:40.108 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:40.103+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:40.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:40.607+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:41.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:41.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:41.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:41.639+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:42.157 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:42.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:42.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:42.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:43.169 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:43.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:43.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:43.663+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:44.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:44.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:44.666 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:44.659+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:45.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:45.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:45.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:45.679+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:46.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:46.235+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:46.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:46.699+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:47.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:47.203+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:47.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:47.667+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:48.199 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:48.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:48.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:48.707+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:49.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:49.231+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:49.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:49.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:50.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:50.195+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:50.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:50.783+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:51.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:51.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:51.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:51.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:52.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:52.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:52.871 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:52.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:53.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:53.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:53.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:53.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:54.171 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:54.167+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:54.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:54.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:55.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:55.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:55.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:55.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:56.150 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:56.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:56.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:56.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:57.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:57.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:57.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:57.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:58.081 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:58.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:58.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:58.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:59.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:19:59.083+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:19:59.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:19:59.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:00.072 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:00.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:00.885 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:00.879+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:01.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:01.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:01.913 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:01.907+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:02.134 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:02.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:02.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:02.951+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:03.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:03.163+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:03.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:03.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:04.133 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:04.127+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:04.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:04.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:05.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:05.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:05.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:05.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:06.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:06.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:06.935 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:06.931+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:07.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:07.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:07.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:07.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:08.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:08.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:08.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:08.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:09.156 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:09.151+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:09.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:09.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:10.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:10.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:10.959 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:10.955+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:11.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:11.211+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:12.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:12.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:12.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:12.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:13.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:13.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:13.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:13.259+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:14.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:13.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:14.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:14.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:14.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:14.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:15.261 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:15.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:16.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:15.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:16.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:16.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:17.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:17.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:17.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:17.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:18.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:17.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:18.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:18.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:18.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:18.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:19.358 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:19.351+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:19.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:19.919+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:20.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:20.363+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:20.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:20.883+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:21.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:21.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:21.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:21.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:22.400 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:22.395+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:22.934 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:22.927+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:23.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:23.447+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:23.909 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:23.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:24.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:24.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:24.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:24.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:25.471 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:25.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:25.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:25.823+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:26.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:26.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:26.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:26.815+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:27.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:27.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:27.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:27.803+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:28.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:28.491+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:28.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:28.819+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:29.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:29.507+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:29.841 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:29.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:30.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:30.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:30.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:30.886+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:31.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:31.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:31.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:31.850+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:32.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:32.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:32.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:32.830+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:33.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:33.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:33.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:33.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:34.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:34.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:34.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:34.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:35.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:35.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:35.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:35.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:36.653 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:36.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:36.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:36.802+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:37.620 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:37.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:37.816 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:37.810+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:38.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:38.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:38.819 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:38.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:39.572 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:39.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:39.788 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:39.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:40.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:40.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:40.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:40.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:41.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:41.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:41.828 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:41.822+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:42.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:42.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:42.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:42.790+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:43.571 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:43.566+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:43.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:43.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:44.559 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:44.554+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:44.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:44.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:45.565 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:45.558+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:45.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:45.842+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:46.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:46.518+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:46.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:46.870+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:47.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:47.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:47.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:47.890+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:48.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:48.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:48.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:48.902+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:49.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:49.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:49.958 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:49.954+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:50.427 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:50.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:50.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:50.930+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:51.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:51.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:51.950 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:51.942+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:52.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:52.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:52.914 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:52.910+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:53.450 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:53.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:53.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:53.866+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:54.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:54.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:54.839 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:54.834+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:55.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:55.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:55.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:55.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:56.396 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:56.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:56.782 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:56.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:57.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:57.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:57.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:57.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:58.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:58.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:58.705 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:58.698+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:59.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:20:59.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:20:59.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:20:59.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:00.435 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:00.430+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:00.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:00.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:01.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:01.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:01.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:01.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:02.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:02.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:02.775 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:02.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:03.256 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-16T14:21:03.256 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T14:21:03.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:21:03.405 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:03.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:03.777 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:03.770+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:04.380 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:04.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:04.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:04.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:05.425 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:05.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:05.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:05.762+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:06.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:06.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:06.803 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:06.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:07.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:07.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:07.800 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:07.794+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:08.379 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:08.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:08.766 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:08.758+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:09.386 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:09.382+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:09.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:09.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:10.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:10.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:10.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:10.742+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:11.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:11.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:11.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:11.706+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:12.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:12.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:12.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:12.718+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:13.420 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:13.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:13.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:13.714+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:14.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:14.462+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:14.691 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:14.686+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:15.500 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:15.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:15.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:15.730+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:16.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:16.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:16.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:16.782+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:17.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:17.494+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:17.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:17.774+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:18.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:18.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:18.785 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:18.778+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:19.430 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:19.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:19.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:19.806+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:20.407 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:20.402+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:20.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:20.846+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:21.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:21.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:21.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:21.798+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:22.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:22.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:22.820 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:22.814+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:23.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:23.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:23.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:23.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:24.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:24.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:24.873 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:24.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:25.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:25.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:25.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:25.869+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:26.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:26.477+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:26.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:26.905+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:27.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:27.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:27.904 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:27.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:28.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:28.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:28.931 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:28.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:29.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:29.461+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:29.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:29.945+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:30.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:30.469+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:30.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:30.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:31.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:31.497+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:31.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:31.969+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:32.534 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:32.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:32.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:32.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:33.564 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:33.557+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:33.963 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:33.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:34.527 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:34.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:34.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:34.925+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:35.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:35.489+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:35.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:35.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:36.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:36.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:36.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:36.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:37.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:37.473+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:37.862 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:37.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:38.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:38.505+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:38.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:38.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:39.522 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:39.513+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:39.861 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:39.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:40.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:40.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:40.834 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:40.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:41.566 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:41.557+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:41.809 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:41.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:42.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:42.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:42.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:42.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:43.613 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:43.605+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:43.804 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:43.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:44.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:44.585+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:44.844 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:44.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:45.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:45.585+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:45.850 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:45.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:46.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:46.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:46.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:46.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:47.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:47.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:47.858 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:47.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:48.510 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:48.501+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:48.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:48.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:49.547 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:49.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:49.856 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:49.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:50.515 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:50.509+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:50.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:50.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:51.528 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:51.521+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:51.842 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:51.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:52.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:52.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:52.833 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:52.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:53.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:53.529+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:53.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:53.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:54.556 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:54.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:54.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:54.781+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:55.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:55.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:55.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:55.765+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:56.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:56.633+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:56.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:56.737+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:57.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:57.669+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:57.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:57.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:58.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:58.665+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:58.810 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:58.805+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:59.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:21:59.633+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:21:59.838 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:21:59.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:00.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:00.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:00.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:00.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:01.655 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:01.649+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:01.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:01.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:02.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:02.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:02.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:02.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:03.624 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:03.617+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:03.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:03.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:04.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:04.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:04.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:04.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:05.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:05.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:05.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:05.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:06.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:06.593+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:06.823 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:06.817+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:07.587 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:07.581+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:07.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:07.837+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:08.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:08.601+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:08.812 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:08.809+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:09.653 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:09.649+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:09.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:09.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:10.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:10.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:10.845 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:10.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:11.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:11.717+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:11.855 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:11.853+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:12.737 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:12.733+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:12.836 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:12.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:13.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:13.701+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:13.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:13.861+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:14.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:14.697+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:14.887 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:14.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:15.663 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:15.661+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:15.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:15.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:16.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:16.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:16.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:16.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:17.728 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:17.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:17.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:17.920+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:18.705 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:18.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:18.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:18.936+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:19.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:19.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:19.912 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:19.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:20.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:20.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:20.879 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:20.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:21.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:21.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:21.895 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:21.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:22.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:22.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:22.875 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:22.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:23.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:23.732+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:23.917 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:23.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:24.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:24.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:24.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:24.892+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:25.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:25.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:25.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:25.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:26.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:26.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:26.827 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:26.824+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:27.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:27.684+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:27.878 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:27.872+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:28.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:28.640+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:28.853 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:28.848+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:29.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:29.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:29.881 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:29.876+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:30.596 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:30.592+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:30.928 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:30.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:31.633 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:31.628+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:31.890 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:31.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:32.658 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:32.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:32.911 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:32.908+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:33.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:33.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:33.892 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:33.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:34.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:34.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:34.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:34.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:35.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:35.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:35.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:35.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:36.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:36.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:36.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:36.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:37.608 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:37.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:37.944 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:37.940+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:38.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:38.652+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:38.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:38.968+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:39.611 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:39.608+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:40.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:40.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:40.581 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:40.576+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:40.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:40.984+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:41.625 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:41.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:41.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:41.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:42.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:42.604+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:43.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:43.004+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:43.618 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:43.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:44.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:44.004+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:44.575 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:44.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:45.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:45.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:45.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:45.588+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:46.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:46.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:46.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:46.564+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:47.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:47.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:47.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:47.548+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:48.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:48.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:48.550 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:48.544+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:49.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:49.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:49.535 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:49.532+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:50.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:50.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:50.509 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:50.504+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:51.148 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:51.144+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:51.473 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:51.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:52.160 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:52.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:52.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:52.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:53.184 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:53.180+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:53.445 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:53.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:54.173 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:54.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:54.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:54.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:55.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:55.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:55.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:55.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:56.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:56.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:56.418 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:56.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:57.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:57.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:57.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:57.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:58.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:58.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:58.426 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:58.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:59.208 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:22:59.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:22:59.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:22:59.472+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:00.176 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:00.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:00.499 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:00.496+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:01.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:01.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:01.502 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:01.500+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:02.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:02.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:02.463 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:02.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:03.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:03.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:03.278 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-16T14:23:03.279 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T14:23:03.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:23:03.426 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T14:23:03.426 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:23:03.426 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T14:23:03.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T14:23:03.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:03.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:03.739 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T14:23:03.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:23:04.035 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:23:04.038 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:23:04.048 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5781,"stamp":"2024-09-16T14:23:02.609312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35016,"ondisk_log_size":35016,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521668,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593852,"statfs":{"total":289910292480,"available":288352104448,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003288"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"163'1580","reported_seq":2605,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106849+0000","last_change":"2024-09-16T11:22:06.765559+0000","last_active":"2024-09-16T12:20:01.106849+0000","last_peered":"2024-09-16T12:20:01.106849+0000","last_clean":"2024-09-16T12:20:01.106849+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T12:20:01.106849+0000","last_undegraded":"2024-09-16T12:20:01.106849+0000","last_fullsized":"2024-09-16T12:20:01.106849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1580,"log_dups_size":0,"ondisk_log_size":1580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:49:47.953388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"163'2172","reported_seq":3225,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:20:01.106663+0000","last_change":"2024-09-16T11:22:06.765623+0000","last_active":"2024-09-16T12:20:01.106663+0000","last_peered":"2024-09-16T12:20:01.106663+0000","last_clean":"2024-09-16T12:20:01.106663+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T12:20:01.106663+0000","last_undegraded":"2024-09-16T12:20:01.106663+0000","last_fullsized":"2024-09-16T12:20:01.106663+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:04:40.133786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15593,"ondisk_log_size":15593,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740618,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533348,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838492,"statfs":{"total":96636764160,"available":96090615808,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39700000000000002},"max":{"1min":0.69399999999999995,"5min":0.71699999999999997,"15min":0.753},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.751,"15min":0.751},"last":0.54000000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:22:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.80500000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65900000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740622,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544984,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826856,"statfs":{"total":96636764160,"available":96078700544,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77100000000000002,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.505},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.46500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.627},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.755}]}]},{"osd":0,"up_from":8,"seq":34359740622,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.83299999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.78100000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45900000000000002},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":0.79900000000000004},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:23:04.051 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.052 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.052 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.052 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.052 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.052 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.053 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.054 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:04.054 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:23:04.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:04.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:04.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:04.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:05.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:05.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:05.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:05.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:06.179 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:06.176+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:06.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:06.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:07.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:07.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:07.458 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:07.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:08.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:08.168+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:08.417 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:08.412+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:09.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:09.204+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:09.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:09.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:10.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:10.188+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:10.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:10.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:11.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:11.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:11.474 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:11.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:12.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:12.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:12.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:12.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:13.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:13.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:13.511 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:13.507+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:14.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:14.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:14.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:14.551+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:15.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:15.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:15.591 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:15.587+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:16.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:16.155+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:16.612 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:16.607+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:17.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:17.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:17.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:17.619+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:18.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:18.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:18.601 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:18.595+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:19.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:19.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:19.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:19.643+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:20.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:20.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:20.642 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:20.639+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:21.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:21.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:21.671 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:21.667+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:22.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:22.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:22.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:22.659+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:23.141 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:23.135+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:23.651 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:23.647+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:24.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:23:24.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:24.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:24.348 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:23:24.351 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:23:24.361 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5791,"stamp":"2024-09-16T14:23:22.614923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003340"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740622,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39700000000000002},"max":{"1min":0.69399999999999995,"5min":0.71699999999999997,"15min":0.753},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.751,"15min":0.751},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Sep 16 14:22:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.50600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.80500000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.45000000000000001},"max":{"1min":0.79600000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.878}]}]},{"osd":1,"up_from":8,"seq":34359740626,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77100000000000002,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.46500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.5},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.64600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740626,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.71599999999999997,"5min":0.80500000000000005,"15min":0.83299999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.78100000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.79800000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58099999999999996,"15min":0.58799999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45900000000000002},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":0.79900000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.72699999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:23:24.362 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.362 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.363 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.364 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.364 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.364 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:24.364 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:23:24.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:24.643+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:25.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:25.179+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:25.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:25.631+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:26.218 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:26.211+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:26.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:26.635+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:27.267 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:27.263+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:27.609 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:27.603+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:28.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:28.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:28.629 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:28.623+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:29.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:29.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:29.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:29.595+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:30.259 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:30.255+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:30.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:30.603+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:31.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:31.303+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:31.597 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:31.591+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:32.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:32.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:32.569 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:32.563+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:33.400 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:33.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:33.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:33.571+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:34.398 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:34.395+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:34.555 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:34.551+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:35.354 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:35.347+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:35.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:35.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:36.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:36.359+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:36.517 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:36.511+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:37.319 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:37.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:37.548 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:37.543+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:38.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:38.319+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:38.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:38.551+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:39.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:39.351+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:39.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:39.571+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:40.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:40.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:40.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:40.531+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:41.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:41.371+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:41.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:41.579+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:42.342 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:42.335+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:42.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:42.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:43.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:43.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:43.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:43.583+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:44.256 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:44.251+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:44.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:23:44.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:44.539+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:44.666 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:23:44.668 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:23:44.678 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5802,"stamp":"2024-09-16T14:23:44.621141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003231"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740627,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.39700000000000002},"max":{"1min":0.69399999999999995,"5min":0.71699999999999997,"15min":0.753},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.751,"15min":0.751},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:23:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.80500000000000005},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.627},"min":{"1min":0.499,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740631,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77100000000000002,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.71499999999999997,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:22:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56999999999999995},"min":{"1min":0.46500000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.55900000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740631,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.83299999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79900000000000004},"last":0.626},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.62},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:23:44.679 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.680 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.681 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.681 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.681 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.681 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:23:44.681 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:23:45.221 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:45.215+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:45.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:45.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:46.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:46.259+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:46.506 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:46.503+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:47.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:47.223+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:47.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:47.551+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:48.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:48.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:48.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:48.519+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:49.249 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:49.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:49.477 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:49.471+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:50.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:50.267+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:50.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:50.515+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:51.237 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:51.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:51.504 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:51.499+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:52.276 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:52.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:52.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:52.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:53.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:53.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:53.415 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:53.411+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:54.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:54.343+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:54.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:54.379+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:55.337 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:55.331+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:55.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:55.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:56.292 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:56.287+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:56.434 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:56.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:57.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:57.331+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:57.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:57.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:58.296 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:58.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:58.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:58.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:59.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:23:59.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:23:59.464 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:23:59.459+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:00.313 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:00.307+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:00.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:00.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:01.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:01.315+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:01.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:01.415+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:02.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:02.311+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:02.439 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:02.435+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:03.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:03.327+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:03.409 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:03.403+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:04.297 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:04.291+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:04.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:04.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:04.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:24:04.979 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:24:04.982 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:24:04.992 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5812,"stamp":"2024-09-16T14:24:04.626598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003265"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740631,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.63500000000000001,"5min":0.71699999999999997,"15min":0.753},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.65300000000000002,"5min":0.72099999999999997,"15min":0.751},"last":0.58599999999999997}]},{"osd":1,"last update":"Mon Sep 16 14:23:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.80500000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.627},"min":{"1min":0.499,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.64200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740635,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.67300000000000004,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.622}]},{"osd":2,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.5,"5min":0.441,"15min":0.441},"max":{"1min":0.63700000000000001,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.69699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740635,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.83299999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79900000000000004},"last":0.628},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.62},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.994 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:04.995 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:24:05.330 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:05.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:05.358 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:05.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:06.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:06.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:06.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:06.334+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:07.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:07.258+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:07.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:07.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:08.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:08.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:08.295 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:08.290+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:09.271 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:09.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:09.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:09.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:10.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:10.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:10.320 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:10.314+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:11.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:11.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:11.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:11.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:12.309 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:12.302+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:12.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:12.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:13.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:13.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:13.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:13.402+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:14.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:14.366+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:14.418 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:14.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:15.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:15.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:15.372 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:15.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:16.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:16.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:16.385 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:16.378+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:17.388 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:17.382+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:17.391 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:17.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:18.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:18.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:18.429 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:18.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:19.306 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:19.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:19.421 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:19.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:20.272 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:20.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:20.398 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:20.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:21.282 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:21.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:21.403 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:21.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:22.334 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:22.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:22.451 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:22.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:23.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:23.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:23.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:23.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:24.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:24.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:24.495 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:24.490+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:24.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:24:25.300 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:24:25.302 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:24:25.313 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5822,"stamp":"2024-09-16T14:24:24.632295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003490"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740635,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.63500000000000001,"5min":0.71699999999999997,"15min":0.753},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.65300000000000002,"5min":0.72099999999999997,"15min":0.751},"last":0.746}]},{"osd":1,"last update":"Mon Sep 16 14:23:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71099999999999997,"5min":0.73099999999999998,"15min":0.80500000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.627},"min":{"1min":0.499,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68100000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740639,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.67300000000000004,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.5,"5min":0.441,"15min":0.441},"max":{"1min":0.63700000000000001,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.59499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740639,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.371},"max":{"1min":0.74199999999999999,"5min":0.80500000000000005,"15min":0.83299999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68500000000000005,"15min":0.68200000000000005},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:23:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.58799999999999997},"min":{"1min":0.50600000000000001,"5min":0.47599999999999998,"15min":0.45900000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.79900000000000004},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.62},"min":{"1min":0.505,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.70299999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:24:25.314 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.314 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.314 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.314 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.315 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.315 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.315 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.315 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.315 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.316 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.316 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:25.316 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:24:25.322 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:25.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:25.543 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:25.538+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:26.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:26.286+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:26.553 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:26.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:27.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:27.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:27.585 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:27.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:28.284 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:28.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:28.537 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:28.530+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:29.260 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:29.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:29.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:29.486+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:30.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:30.258+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:30.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:30.474+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:31.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:31.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:31.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:31.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:32.240 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:32.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:32.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:32.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:33.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:33.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:33.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:33.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:34.252 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:34.246+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:34.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:34.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:35.209 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:35.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:35.457 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:35.450+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:36.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:36.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:36.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:36.414+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:37.216 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:37.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:37.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:37.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:38.199 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:38.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:38.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:38.378+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:39.190 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:39.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:39.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:39.330+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:40.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:40.154+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:40.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:40.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:41.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:41.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:41.344 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:41.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:42.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:42.174+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:42.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:42.298+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:43.136 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:43.130+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:43.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:43.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:44.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:44.098+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:44.238 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:44.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:45.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:45.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:45.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:45.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:45.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:24:45.619 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:24:45.622 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:24:45.632 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5832,"stamp":"2024-09-16T14:24:44.637739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740639,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53400000000000003,"15min":0.53700000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.63500000000000001,"5min":0.71699999999999997,"15min":0.753},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.65300000000000002,"5min":0.72099999999999997,"15min":0.751},"last":0.67200000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.499,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.57699999999999996,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.73699999999999999,"5min":0.878,"15min":0.878},"last":0.628}]}]},{"osd":1,"up_from":8,"seq":34359740643,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.745,"5min":0.78000000000000003,"15min":0.79600000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.51000000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.67300000000000004,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:23:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.5,"5min":0.441,"15min":0.441},"max":{"1min":0.63700000000000001,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.56699999999999995,"5min":0.504,"15min":0.504},"max":{"1min":0.76000000000000001,"5min":0.875,"15min":0.875},"last":0.68500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.83299999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.68000000000000005},"min":{"1min":0.57199999999999995,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":0.71599999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:24:45.633 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.634 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.635 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.635 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.635 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.635 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:24:45.635 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:24:46.142 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:46.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:46.294 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:46.290+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:47.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:47.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:47.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:47.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:48.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:48.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:48.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:48.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:49.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:49.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:49.217 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:49.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:50.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:50.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:50.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:50.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:51.107 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:51.102+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:51.216 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:51.210+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:52.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:52.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:52.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:52.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:53.055 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:53.050+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:53.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:53.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:54.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:54.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:54.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:54.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:55.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:55.050+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:55.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:55.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:56.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:56.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:56.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:56.234+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:56.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:56.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:57.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:57.206+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:57.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:57.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:58.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:58.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:58.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:58.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:59.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:24:59.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:24:59.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:24:59.865+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:00.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:00.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:00.830 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:00.825+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:01.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:01.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:01.826 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:01.821+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:02.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:02.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:02.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:02.849+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:03.197 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:03.189+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:03.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:03.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:04.166 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:04.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:04.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:04.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:05.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:05.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:05.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:25:05.840 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:05.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:05.924 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:25:05.926 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:25:05.937 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5842,"stamp":"2024-09-16T14:25:04.643011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003155"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740643,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.47999999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.54800000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.751},"last":0.63600000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.499,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.57699999999999996,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.73699999999999999,"5min":0.878,"15min":0.878},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740647,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.56999999999999995,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.76500000000000001,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.63}]},{"osd":2,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.45100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.75600000000000001,"5min":0.875,"15min":0.875},"last":0.57899999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740647,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.83299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.68000000000000005},"min":{"1min":0.57199999999999995,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":0.71599999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:25:05.938 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.938 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.938 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.939 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.939 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.939 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.939 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.939 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.940 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.940 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.940 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:05.940 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:25:06.160 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:06.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:06.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:06.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:07.179 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:07.173+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:07.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:07.757+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:08.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:08.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:08.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:08.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:09.193 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:09.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:09.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:09.813+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:10.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:10.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:10.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:10.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:11.161 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:11.153+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:11.837 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:11.829+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:12.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:12.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:12.852 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:12.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:13.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:13.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:13.854 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:13.845+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:14.170 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:14.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:14.882 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:14.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:15.221 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:15.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:15.898 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:15.889+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:16.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:16.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:16.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:16.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:17.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:17.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:17.920 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:17.913+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:18.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:18.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:18.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:18.949+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:19.292 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:19.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:19.923 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:19.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:20.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:20.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:20.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:20.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:21.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:21.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:21.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:21.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:22.389 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:22.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:22.883 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:22.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:23.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:23.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:23.849 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:23.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:24.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:24.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:24.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:24.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:25.337 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:25.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:25.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:25.909+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:25.941 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:25:26.246 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:25:26.249 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:25:26.260 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5852,"stamp":"2024-09-16T14:25:24.648116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35106,"ondisk_log_size":35106,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521660,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593860,"statfs":{"total":289910292480,"available":288352112640,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002962"},"pg_stats":[{"pgid":"2.7","version":"163'1902","reported_seq":2951,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067366+0000","last_change":"2024-09-16T11:22:06.761350+0000","last_active":"2024-09-16T12:19:58.067366+0000","last_peered":"2024-09-16T12:19:58.067366+0000","last_clean":"2024-09-16T12:19:58.067366+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T12:19:58.067366+0000","last_undegraded":"2024-09-16T12:19:58.067366+0000","last_fullsized":"2024-09-16T12:19:58.067366+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1902,"log_dups_size":0,"ondisk_log_size":1902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:12:24.737066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'1700","reported_seq":2685,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067234+0000","last_change":"2024-09-16T11:22:06.761202+0000","last_active":"2024-09-16T12:19:58.067234+0000","last_peered":"2024-09-16T12:19:58.067234+0000","last_clean":"2024-09-16T12:19:58.067234+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T12:19:58.067234+0000","last_undegraded":"2024-09-16T12:19:58.067234+0000","last_fullsized":"2024-09-16T12:19:58.067234+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1700,"log_dups_size":0,"ondisk_log_size":1700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:10:29.698236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3090,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067043+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:19:58.067043+0000","last_peered":"2024-09-16T12:19:58.067043+0000","last_clean":"2024-09-16T12:19:58.067043+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:19:58.067043+0000","last_undegraded":"2024-09-16T12:19:58.067043+0000","last_fullsized":"2024-09-16T12:19:58.067043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:16:34.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'2100","reported_seq":3119,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067004+0000","last_change":"2024-09-16T11:22:06.761582+0000","last_active":"2024-09-16T12:19:58.067004+0000","last_peered":"2024-09-16T12:19:58.067004+0000","last_clean":"2024-09-16T12:19:58.067004+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T12:19:58.067004+0000","last_undegraded":"2024-09-16T12:19:58.067004+0000","last_fullsized":"2024-09-16T12:19:58.067004+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:37.712803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11022,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066113+0000","last_change":"2024-09-16T11:22:06.758173+0000","last_active":"2024-09-16T12:19:58.066113+0000","last_peered":"2024-09-16T12:19:58.066113+0000","last_clean":"2024-09-16T12:19:58.066113+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T12:19:58.066113+0000","last_undegraded":"2024-09-16T12:19:58.066113+0000","last_fullsized":"2024-09-16T12:19:58.066113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:52.784063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"163'1695","reported_seq":2767,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066150+0000","last_change":"2024-09-16T11:22:06.757505+0000","last_active":"2024-09-16T12:19:58.066150+0000","last_peered":"2024-09-16T12:19:58.066150+0000","last_clean":"2024-09-16T12:19:58.066150+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T12:19:58.066150+0000","last_undegraded":"2024-09-16T12:19:58.066150+0000","last_fullsized":"2024-09-16T12:19:58.066150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":1695,"log_dups_size":0,"ondisk_log_size":1695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:20:35.891743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11743,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066482+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:19:58.066482+0000","last_peered":"2024-09-16T12:19:58.066482+0000","last_clean":"2024-09-16T12:19:58.066482+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:19:58.066482+0000","last_undegraded":"2024-09-16T12:19:58.066482+0000","last_fullsized":"2024-09-16T12:19:58.066482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:28:15.664741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"163'5133","reported_seq":10683,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066072+0000","last_change":"2024-09-16T11:22:06.760035+0000","last_active":"2024-09-16T12:19:58.066072+0000","last_peered":"2024-09-16T12:19:58.066072+0000","last_clean":"2024-09-16T12:19:58.066072+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T12:19:58.066072+0000","last_undegraded":"2024-09-16T12:19:58.066072+0000","last_fullsized":"2024-09-16T12:19:58.066072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5133,"log_dups_size":0,"ondisk_log_size":5133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:06:20.800358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12537,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.066929+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:19:58.066929+0000","last_peered":"2024-09-16T12:19:58.066929+0000","last_clean":"2024-09-16T12:19:58.066929+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:19:58.066929+0000","last_undegraded":"2024-09-16T12:19:58.066929+0000","last_fullsized":"2024-09-16T12:19:58.066929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:01.235019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"163'2402","reported_seq":3423,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067076+0000","last_change":"2024-09-16T11:22:06.760605+0000","last_active":"2024-09-16T12:19:58.067076+0000","last_peered":"2024-09-16T12:19:58.067076+0000","last_clean":"2024-09-16T12:19:58.067076+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T12:19:58.067076+0000","last_undegraded":"2024-09-16T12:19:58.067076+0000","last_fullsized":"2024-09-16T12:19:58.067076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2402,"log_dups_size":0,"ondisk_log_size":2402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:57:45.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'52","reported_seq":229,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-16T12:19:58.067074+0000","last_change":"2024-09-16T11:15:50.652469+0000","last_active":"2024-09-16T12:19:58.067074+0000","last_peered":"2024-09-16T12:19:58.067074+0000","last_clean":"2024-09-16T12:19:58.067074+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T12:19:58.067074+0000","last_undegraded":"2024-09-16T12:19:58.067074+0000","last_fullsized":"2024-09-16T12:19:58.067074+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:49.636932+0000","last_clean_scrub_stamp":"2024-09-16T11:15:49.636932+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:24.811366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19371,"ondisk_log_size":19371,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":445,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15683,"ondisk_log_size":15683,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740647,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.47999999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.504},{"interface":"front","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.54800000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.751},"last":0.71599999999999997}]},{"osd":1,"last update":"Mon Sep 16 14:24:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.499,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.57699999999999996,"5min":0.499,"15min":0.45000000000000001},"max":{"1min":0.73699999999999999,"5min":0.878,"15min":0.878},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359740651,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.56999999999999995,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.751},{"interface":"front","average":{"1min":0.624,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.76500000000000001,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.45100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.75600000000000001,"5min":0.875,"15min":0.875},"last":0.67700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740651,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443336,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928504,"statfs":{"total":96636764160,"available":96182788096,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.42299999999999999,"5min":0.41999999999999998,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.83299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.68000000000000005},"min":{"1min":0.57199999999999995,"5min":0.50800000000000001,"15min":0.47399999999999998},"max":{"1min":0.76200000000000001,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:24:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58699999999999997,"15min":0.58799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45900000000000002},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.47199999999999998},"max":{"1min":0.71599999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:25:26.261 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.261 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.262 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.263 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.263 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.263 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T11:15:49.636932+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=49, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:26.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2024-09-16T14:25:26.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:26.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:26.560 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2024-09-16T14:25:26.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2024-09-16T14:25:26.864 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2024-09-16T14:25:26.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2024-09-16T14:25:26.899 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:26.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:27.161 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2024-09-16T14:25:27.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2024-09-16T14:25:27.335 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:27.329+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:27.515 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2024-09-16T14:25:27.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:25:27.815 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:25:27.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2024-09-16T14:25:27.946 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:27.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:28.117 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2024-09-16T14:25:28.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2024-09-16T14:25:28.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:28.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:28.420 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2024-09-16T14:25:28.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:25:28.716 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:25:28.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:25:28.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:28.977+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:29.013 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:25:29.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2024-09-16T14:25:29.314 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2024-09-16T14:25:29.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2024-09-16T14:25:29.362 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:29.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:29.646 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2024-09-16T14:25:29.656 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:25:29.987 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:29.981+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:30.376 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:30.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:30.945 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:30.937+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:31.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:31.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:31.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:31.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:32.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:32.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:32.907 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:32.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:33.424 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:33.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:33.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:33.929+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:34.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:34.429+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:34.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:34.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:35.390 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:35.381+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:35.925 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:35.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:36.360 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:36.353+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:36.949 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:36.941+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:37.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:37.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:37.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:37.917+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:38.341 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:38.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:38.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:38.893+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:39.338 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:39.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:39.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:39.885+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:40.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:40.357+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:40.880 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:40.877+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:41.402 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:41.397+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:41.924 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:41.921+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:42.382 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:42.377+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:42.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:42.953+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:43.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:43.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:43.960 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:43.957+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:44.306 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:44.305+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:44.966 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:44.965+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:45.272 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:45.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:46.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:46.009+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:46.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:46.249+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:47.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:47.049+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:47.209 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:47.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:48.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:48.065+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:48.241 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:48.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:49.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:49.069+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:49.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:49.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:49.657 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:25:49.958 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:25:49.960 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:25:49.970 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5864,"stamp":"2024-09-16T14:25:48.654849+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1249,"num_omap_keys":128,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35389,"ondisk_log_size":35389,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1521656,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":912827,"kb_avail":281593864,"statfs":{"total":289910292480,"available":288352116736,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":934734856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":322,"num_omap_keys":34,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003423"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'2042","reported_seq":3091,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T12:20:03.068920+0000","last_change":"2024-09-16T11:22:06.760952+0000","last_active":"2024-09-16T12:20:03.068920+0000","last_peered":"2024-09-16T12:20:03.068920+0000","last_clean":"2024-09-16T12:20:03.068920+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T12:20:03.068920+0000","last_undegraded":"2024-09-16T12:20:03.068920+0000","last_fullsized":"2024-09-16T12:20:03.068920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:15:52.912603+0000","last_clean_scrub_stamp":"2024-09-16T11:15:52.912603+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"164'5305","reported_seq":11744,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T12:20:03.068541+0000","last_change":"2024-09-16T11:22:06.760562+0000","last_active":"2024-09-16T12:20:03.068541+0000","last_peered":"2024-09-16T12:20:03.068541+0000","last_clean":"2024-09-16T12:20:03.068541+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T12:20:03.068541+0000","last_undegraded":"2024-09-16T12:20:03.068541+0000","last_fullsized":"2024-09-16T12:20:03.068541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":5305,"log_dups_size":0,"ondisk_log_size":5305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12538,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T12:20:03.068663+0000","last_change":"2024-09-16T11:22:06.764830+0000","last_active":"2024-09-16T12:20:03.068663+0000","last_peered":"2024-09-16T12:20:03.068663+0000","last_clean":"2024-09-16T12:20:03.068663+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T12:20:03.068663+0000","last_undegraded":"2024-09-16T12:20:03.068663+0000","last_fullsized":"2024-09-16T12:20:03.068663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19395,"ondisk_log_size":19395,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1249,"num_omap_keys":128,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15940,"ondisk_log_size":15940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740651,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.47999999999999998,"5min":0.41599999999999998,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.54800000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.746,"5min":0.746,"15min":0.751},"last":0.40600000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68300000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.628,"15min":0.626},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68000000000000005,"5min":0.878,"15min":0.878},"last":0.35399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740655,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544980,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":305662,"kb_avail":93826860,"statfs":{"total":96636764160,"available":96078704640,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":312998232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.56999999999999995,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.76500000000000001,"5min":0.77400000000000002,"15min":1.1299999999999999},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:24:51 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.45100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.94099999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.75600000000000001,"5min":0.875,"15min":0.875},"last":0.60799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740655,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.70699999999999996,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:25:49.971 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T11:15:52.912603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=15, tm_sec=52, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:49.971 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:49.972 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:49.972 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:49.972 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:25:49.972 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:25:50.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:50.109+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:50.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:50.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:51.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:51.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:51.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:51.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:52.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:52.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:52.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:52.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:53.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:53.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:53.375 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:53.372+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:54.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:54.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:54.408 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:54.404+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:55.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:55.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:55.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:55.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:56.035 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:56.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:56.497 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:56.492+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:56.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:56.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:57.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:57.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:57.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:57.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:58.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:58.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:58.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:25:58.972+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:25:59.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:25:59.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:00.017 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:00.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:00.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:00.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:01.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:01.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:01.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:01.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:01.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:01.992+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:02.459 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:02.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:03.004 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:03.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:03.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:03.408+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:04.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:04.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:04.431 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:04.428+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:05.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:05.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:05.388 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:05.384+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:06.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:06.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:06.373 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:06.368+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:07.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:07.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:07.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:07.420+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:08.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:08.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:08.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:08.400+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:09.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:09.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:09.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:09.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:09.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:26:10.064 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:10.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:10.271 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:26:10.274 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:26:10.284 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5874,"stamp":"2024-09-16T14:26:08.660643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740655,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.746,"15min":0.751},"last":0.59599999999999997}]},{"osd":1,"last update":"Mon Sep 16 14:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68300000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.628,"15min":0.626},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68000000000000005,"5min":0.878,"15min":0.878},"last":0.64400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740659,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.52800000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.751,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.1299999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74199999999999999,"5min":0.875,"15min":0.875},"last":0.71899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740659,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.70699999999999996,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:26:10.286 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:10.286 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:10.286 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:10.286 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:26:10.478 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:10.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:11.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:11.100+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:11.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:11.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:12.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:12.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:12.512 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:12.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:13.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:13.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:13.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:13.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:14.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:14.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:14.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:14.456+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:15.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:15.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:15.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:15.476+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:16.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:16.160+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:16.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:16.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:17.135 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:17.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:17.455 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:17.452+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:18.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:18.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:18.446 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:18.444+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:19.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:19.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:19.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:19.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:20.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:20.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:20.489 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:20.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:21.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:21.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:21.513 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:21.508+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:22.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:22.044+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:22.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:22.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:23.005 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:23.000+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:23.467 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:23.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:24.030 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:24.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:24.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:24.464+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:25.065 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:25.060+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:25.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:25.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:26.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:26.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:26.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:26.440+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:27.086 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:27.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:27.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:27.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:28.101 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:28.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:28.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:28.468+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:29.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:29.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:29.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:29.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:30.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:30.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:30.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:26:30.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:30.528+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:30.589 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:26:30.592 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:26:30.602 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5884,"stamp":"2024-09-16T14:26:28.666247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003367"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740659,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.746,"15min":0.751},"last":0.57999999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:25:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68300000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.628,"15min":0.626},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68000000000000005,"5min":0.878,"15min":0.878},"last":0.65300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740663,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.52800000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.751,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.1299999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74199999999999999,"5min":0.875,"15min":0.875},"last":0.71999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740663,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:25:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.70699999999999996,"5min":0.77800000000000002,"15min":0.79400000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:26:30.604 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:30.604 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:30.604 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:30.604 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:26:31.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:31.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:31.491 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:31.488+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:32.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:32.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:32.540 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:32.536+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:33.013 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:33.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:33.545 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:33.540+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:34.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:34.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:34.574 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:34.572+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:34.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:34.984+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:35.623 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:35.620+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:35.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:35.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:36.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:36.648+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:36.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:36.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:37.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:37.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:37.951 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:37.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:38.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:38.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:38.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:38.960+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:39.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:39.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:39.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:39.980+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:40.664 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:40.660+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:40.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:40.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:41.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:41.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:41.990 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:41.988+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:42.638 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:42.636+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:42.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:42.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:43.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:43.603+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:43.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:43.923+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:44.636 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:44.631+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:44.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:44.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:45.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:45.679+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:45.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:45.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:46.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:46.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:47.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:46.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:47.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:47.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:48.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:48.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:48.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:48.687+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:49.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:49.043+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:49.713 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:49.707+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:50.088 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:50.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:50.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:26:50.720 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:50.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:50.897 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:26:50.900 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:26:50.911 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5895,"stamp":"2024-09-16T14:26:50.672506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003347"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740664,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:00 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71699999999999997,"15min":0.753},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.746,"15min":0.751},"last":0.56200000000000006}]},{"osd":1,"last update":"Mon Sep 16 14:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.51300000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76400000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.64300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740668,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.52800000000000002},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.751,"5min":0.77100000000000002,"15min":0.79600000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.46999999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":1.1299999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:25:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65800000000000003,"15min":0.66100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74199999999999999,"5min":0.875,"15min":0.875},"last":0.60299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740668,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.436,"5min":0.251,"15min":0.251},"max":{"1min":0.755,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.58099999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.02,"15min":1.02},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:26:50.912 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:50.912 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:50.913 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:26:50.913 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:26:51.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:51.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:51.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:51.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:52.046 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:52.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:52.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:52.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:53.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:52.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:53.677 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:53.671+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:54.008 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:54.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:54.724 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:54.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:55.041 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:55.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:55.736 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:55.731+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:56.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:56.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:56.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:56.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:57.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:57.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:57.730 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:57.727+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:58.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:58.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:58.761 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:58.755+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:59.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:26:59.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:26:59.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:26:59.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:00.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:00.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:00.781 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:00.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:01.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:01.139+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:01.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:01.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:02.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:02.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:02.758 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:02.751+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:03.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:03.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:03.792 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:03.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:04.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:04.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:04.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:04.747+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:05.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:05.123+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:05.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:05.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:06.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:06.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:06.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:06.683+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:07.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:07.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:07.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:07.699+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:08.114 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:08.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:08.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:08.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:09.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:09.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:09.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:09.731+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:10.177 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:10.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:10.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:10.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:10.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:27:11.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:11.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:11.206 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:27:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:27:11.220 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5905,"stamp":"2024-09-16T14:27:10.678225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003302"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740668,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.47799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.71799999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.46100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64400000000000002,"5min":0.746,"15min":0.751},"last":0.624}]},{"osd":1,"last update":"Mon Sep 16 14:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.51300000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76400000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.498},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.66500000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740672,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79600000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.51500000000000001,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.66100000000000003},"min":{"1min":0.57599999999999996,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":0.875},"last":0.60799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740673,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.436,"5min":0.251,"15min":0.251},"max":{"1min":0.755,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.58099999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.02,"15min":1.02},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:27:11.221 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:11.221 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:11.222 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:11.222 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:27:11.836 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:11.831+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:12.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:12.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:12.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:12.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:13.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:13.271+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:13.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:13.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:14.243 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:14.239+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:14.795 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:14.791+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:15.283 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:15.279+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:15.793 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:15.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:16.251 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:16.247+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:16.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:16.743+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:17.225 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:17.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:17.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:17.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:18.248 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:18.243+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:18.745 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:18.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:19.231 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:19.227+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:19.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:19.707+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:20.191 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:20.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:20.731 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:20.727+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:21.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:21.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:21.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:21.747+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:22.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:22.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:22.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:22.731+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:23.175 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:23.171+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:23.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:23.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:24.151 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:24.147+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:24.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:24.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:25.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:25.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:25.786 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:25.779+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:26.180 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:26.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:26.782 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:26.775+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:27.169 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:27.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:27.806 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:27.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:28.193 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:28.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:28.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:28.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:29.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:29.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:29.811 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:29.807+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:30.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:30.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:30.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:30.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:31.198 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:31.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:31.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:27:31.514 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:27:31.517 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:27:31.527 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5915,"stamp":"2024-09-16T14:27:30.683632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003258"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740672,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.47799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.71799999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.46100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64400000000000002,"5min":0.746,"15min":0.751},"last":0.60299999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:26:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58199999999999996,"15min":0.58899999999999997},"min":{"1min":0.51300000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76400000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.504},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.625,"15min":0.625},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72899999999999998,"5min":0.878,"15min":0.878},"last":0.55300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740676,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79600000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69799999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.51500000000000001,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.66100000000000003},"min":{"1min":0.57599999999999996,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":0.875},"last":0.626}]}]},{"osd":0,"up_from":8,"seq":34359740677,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.436,"5min":0.251,"15min":0.251},"max":{"1min":0.755,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.58099999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":1.02,"15min":1.02},"last":0.74199999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:26:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73799999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:27:31.528 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:31.529 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:31.529 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:31.529 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:27:31.805 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:31.799+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:32.165 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:32.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:32.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:32.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:33.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:33.159+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:33.871 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:33.867+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:34.122 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:34.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:34.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:34.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:35.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:35.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:35.848 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:35.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:36.106 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:36.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:36.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:36.846+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:37.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:37.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:37.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:37.842+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:38.074 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:38.066+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:38.838 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:38.830+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:39.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:39.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:39.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:39.842+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:40.150 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:40.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:40.819 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:40.814+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:41.162 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:41.154+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:41.868 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:41.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:42.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:42.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:42.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:42.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:43.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:43.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:43.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:43.914+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:44.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:44.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:44.957 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:44.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:45.097 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:45.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:46.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:45.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:46.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:46.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:47.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:47.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:47.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:47.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:48.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:48.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:48.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:48.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:49.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:49.054+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:49.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:49.074+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:50.050 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:50.046+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:50.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:50.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:51.086 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:51.082+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:51.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:51.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:51.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:27:51.828 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:27:51.840 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5925,"stamp":"2024-09-16T14:27:50.689220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003444"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740676,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.53100000000000003},"min":{"1min":0.47799999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.71799999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.46100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64400000000000002,"5min":0.746,"15min":0.751},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69299999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.55100000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.878,"15min":0.878},"last":0.65800000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740680,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79600000000000004},"last":0.436},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.46999999999999997},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53800000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:26:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.57199999999999995},"min":{"1min":0.51500000000000001,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.68000000000000005,"5min":0.70299999999999996,"15min":0.94099999999999995},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.66100000000000003},"min":{"1min":0.57599999999999996,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.875,"15min":0.875},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740681,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.57899999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.751,"5min":1.02,"15min":1.02},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.47499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:27:51.842 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:51.842 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:51.843 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:27:51.843 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:27:52.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:52.078+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:52.123 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:52.118+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:53.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:53.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:53.178 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:53.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:54.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:54.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:54.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:54.166+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:55.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:55.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:55.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:55.170+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:56.061 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:56.054+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:56.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:56.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:57.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:57.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:57.268 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:57.262+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:58.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:58.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:58.289 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:58.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:59.153 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:27:59.146+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:27:59.257 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:27:59.250+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:00.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:00.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:00.235 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:00.230+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:01.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:01.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:01.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:01.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:02.125 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:02.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:02.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:02.266+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:03.090 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:03.082+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:03.264 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:03.258+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:04.115 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:04.110+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:04.301 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:04.294+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:05.149 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:05.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:05.325 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:05.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:06.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:06.194+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:06.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:06.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:07.215 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:07.210+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:07.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:07.278+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:08.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:08.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:08.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:08.322+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:09.183 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:09.178+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:09.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:09.346+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:10.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:10.186+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:10.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:10.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:11.232 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:11.226+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:11.368 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:11.362+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:11.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:28:12.136 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:28:12.139 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:28:12.149 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5935,"stamp":"2024-09-16T14:28:10.694760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003145"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11027,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944430+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944430+0000","last_peered":"2024-09-16T14:25:27.944430+0000","last_clean":"2024-09-16T14:25:27.944430+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944430+0000","last_undegraded":"2024-09-16T14:25:27.944430+0000","last_fullsized":"2024-09-16T14:25:27.944430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10713,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.052747+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.052747+0000","last_peered":"2024-09-16T14:25:34.052747+0000","last_clean":"2024-09-16T14:25:34.052747+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.052747+0000","last_undegraded":"2024-09-16T14:25:34.052747+0000","last_fullsized":"2024-09-16T14:25:34.052747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12542,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257053+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257053+0000","last_peered":"2024-09-16T14:25:49.257053+0000","last_clean":"2024-09-16T14:25:49.257053+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257053+0000","last_undegraded":"2024-09-16T14:25:49.257053+0000","last_fullsized":"2024-09-16T14:25:49.257053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740680,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:28:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.71799999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73299999999999998,"5min":0.746,"15min":0.751},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69299999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.55100000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.878,"15min":0.878},"last":0.66000000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740684,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64600000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.94099999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.54900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740685,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.57899999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.751,"5min":1.02,"15min":1.02},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.63},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.47499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:28:12.150 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:12.150 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:12.150 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:12.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:28:12.269 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:12.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:12.364 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:12.358+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:12.438 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:28:12.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:28:12.737 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:28:12.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:28:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:28:13.057 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:28:13.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:13.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:13.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:13.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:14.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:14.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:14.346 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:14.338+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:15.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:15.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:15.394 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:15.390+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:16.307 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:16.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:16.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:16.374+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:17.352 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:17.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:17.422 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:17.418+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:18.392 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:18.386+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:18.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:18.390+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:19.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:19.342+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:19.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:19.374+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:20.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:20.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:20.363 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:20.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:21.320 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:21.314+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:21.331 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:21.326+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:22.303 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:22.298+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:22.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:22.354+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:23.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:23.306+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:23.348 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:23.342+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:24.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:24.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:24.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:24.318+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:25.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:25.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:25.312 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:25.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:26.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:26.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:26.340 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:26.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:27.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:27.282+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:27.361 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:27.354+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:28.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:28.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:28.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:28.386+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:29.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:29.289+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:29.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:29.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:30.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:30.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:30.416 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:30.409+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:31.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:31.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:31.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:31.421+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:32.293 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:32.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:32.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:32.461+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:33.057 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:28:33.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:33.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:33.350 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:28:33.353 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:28:33.366 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5946,"stamp":"2024-09-16T14:28:32.700873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003387"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740684,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:28:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.71799999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73299999999999998,"5min":0.746,"15min":0.751},"last":0.52000000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:27:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.47699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69299999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.55100000000000005,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72399999999999998,"5min":0.878,"15min":0.878},"last":0.56599999999999995}]}]},{"osd":1,"up_from":8,"seq":34359740688,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.621}]},{"osd":2,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.94099999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.68799999999999994}]}]},{"osd":0,"up_from":8,"seq":34359740689,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54500000000000004,"15min":0.55600000000000005},"min":{"1min":0.41799999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.72299999999999998,"5min":0.81699999999999995,"15min":0.83299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.57899999999999996,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.751,"5min":1.02,"15min":1.02},"last":0.60199999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:27:42 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.45400000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.47499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:28:33.368 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:33.368 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:33.368 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:33.368 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:28:33.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:33.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:34.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:34.277+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:34.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:34.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:35.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:35.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:35.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:35.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:36.228 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:36.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:36.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:36.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:37.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:37.205+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:37.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:37.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:38.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:38.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:38.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:38.581+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:39.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:39.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:39.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:39.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:40.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:40.297+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:40.525 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:40.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:41.280 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:41.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:41.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:41.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:42.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:42.229+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:42.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:42.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:43.249 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:43.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:43.550 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:43.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:44.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:44.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:44.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:44.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:45.316 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:45.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:45.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:45.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:46.342 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:46.337+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:46.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:46.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:47.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:47.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:47.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:47.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:48.314 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:48.309+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:48.591 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:48.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:49.288 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:49.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:49.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:49.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:50.274 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:50.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:50.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:50.609+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:51.231 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:51.225+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:51.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:51.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:52.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:52.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:52.544 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:52.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:53.260 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:53.253+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:53.370 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:28:53.567 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:53.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:53.675 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:28:53.677 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:28:53.688 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5956,"stamp":"2024-09-16T14:28:52.706255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003178"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740688,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:28:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.71799999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73299999999999998,"5min":0.746,"15min":0.751},"last":0.52800000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:28:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.48699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.878},"last":0.69899999999999995}]}]},{"osd":1,"up_from":8,"seq":34359740692,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:27:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.94099999999999995},"last":0.622},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.56200000000000006,"5min":0.52600000000000002,"15min":0.504},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.875},"last":0.60599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740693,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.59599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":1.02,"15min":1.02},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.496},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.503,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71899999999999997,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:28:53.689 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:53.689 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:53.689 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:28:53.690 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:28:54.287 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:54.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:54.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:54.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:55.333 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:55.325+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:55.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:55.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:56.340 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:56.333+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:56.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:56.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:57.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:57.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:57.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:57.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:58.326 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:58.317+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:58.712 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:58.705+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:59.347 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:28:59.341+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:28:59.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:28:59.749+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:00.374 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:00.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:00.747 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:00.741+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:01.423 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:01.417+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:01.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:01.705+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:02.438 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:02.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:02.740 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:02.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:03.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:03.433+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:03.790 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:03.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:04.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:04.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:04.807 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:04.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:05.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:05.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:05.805 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:05.797+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:06.492 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:06.485+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:06.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:06.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:07.490 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:07.481+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:07.808 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:07.801+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:08.498 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:08.493+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:08.783 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:08.777+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:09.454 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:09.445+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:09.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:09.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:10.462 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:10.453+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:10.779 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:10.773+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:11.414 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:11.405+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:11.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:11.785+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:12.372 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:12.369+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:12.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:12.745+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:13.363 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:13.361+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:13.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:29:13.778 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:13.769+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:13.989 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:29:13.992 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:29:14.002 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5966,"stamp":"2024-09-16T14:29:12.712104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003653"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740692,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:28:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.68200000000000005,"15min":0.71799999999999997},"last":0.499},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.73299999999999998,"5min":0.746,"15min":0.751},"last":0.64800000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:28:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.48699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.878},"last":0.68100000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740696,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.84499999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.875},"last":0.65800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740697,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.59599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":1.02,"15min":1.02},"last":0.65900000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.503,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71899999999999997,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:29:14.003 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:14.004 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:14.004 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:14.004 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:29:14.397 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:14.393+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:14.794 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:14.789+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:15.351 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:15.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:15.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:15.833+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:16.352 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:16.349+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:16.797 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:16.793+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:17.324 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:17.321+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:17.843 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:17.841+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:18.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:18.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:18.859 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:18.857+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:19.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:19.273+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:19.902 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:19.901+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:20.265 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:20.261+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:20.874 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:20.873+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:21.224 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:21.221+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:21.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:21.897+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:22.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:22.201+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:22.936 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:22.933+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:23.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:23.237+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:23.948 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:23.944+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:24.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:24.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:24.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:24.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:25.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:25.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:25.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:25.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:26.251 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:26.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:26.916 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:26.912+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:27.275 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:27.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:27.933 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:27.928+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:28.290 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:28.284+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:28.952 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:28.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:29.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:29.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:29.953 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:29.948+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:30.230 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:30.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:30.968 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:30.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:31.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:31.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:31.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:31.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:32.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:32.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:33.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:32.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:33.226 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:33.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:34.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:29:34.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:34.020+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:34.240 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:34.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:34.296 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:29:34.299 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:29:34.310 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5976,"stamp":"2024-09-16T14:29:32.717792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003427"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740696,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.439,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.496,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.746,"15min":0.751},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Sep 16 14:28:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.48699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.628},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.878},"last":0.65500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740700,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.505},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.84499999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.875},"last":0.60099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740701,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.59599999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":1.02,"15min":1.02},"last":0.626}]},{"osd":2,"last update":"Mon Sep 16 14:28:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.58899999999999997},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.78200000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.503,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71899999999999997,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:29:34.312 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:34.312 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:34.312 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:34.312 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:29:35.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:35.016+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:35.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:35.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:36.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:36.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:36.211 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:36.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:37.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:37.068+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:37.191 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:37.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:38.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:38.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:38.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:38.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:39.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:39.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:39.195 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:39.192+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:40.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:40.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:40.183 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:40.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:41.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:41.120+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:41.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:41.184+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:42.119 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:42.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:42.181 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:42.176+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:43.076 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:43.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:43.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:43.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:44.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:44.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:44.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:44.144+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:45.120 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:45.116+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:45.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:45.152+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:46.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:46.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:46.167 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:46.164+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:47.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:47.072+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:47.159 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:47.156+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:48.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:48.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:48.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:48.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:49.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:49.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:49.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:49.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:50.117 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:50.112+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:50.239 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:50.236+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:51.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:51.132+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:51.198 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:51.196+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:52.178 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:52.172+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:52.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:52.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:53.138 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:53.136+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:53.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:53.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:54.152 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:54.148+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:54.298 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:54.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:54.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:29:54.613 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:29:54.616 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:29:54.625 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5986,"stamp":"2024-09-16T14:29:52.723341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740700,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:29:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.439,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.496,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":0.746,"15min":0.751},"last":0.61299999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.627},"min":{"1min":0.54100000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.878},"last":0.66600000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740704,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.69299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.52900000000000003,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.84499999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:29:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.47399999999999998,"5min":0.45100000000000001,"15min":0.441},"max":{"1min":0.748,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64900000000000002,"15min":0.65900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.77400000000000002,"5min":0.80800000000000005,"15min":0.875},"last":0.64200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740705,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.72399999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.02,"15min":1.02},"last":0.61599999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.53400000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:29:54.627 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:54.627 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:54.627 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:29:54.627 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:29:55.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:55.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:55.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:55.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:56.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:56.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:56.350 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:56.348+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:57.110 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:57.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:57.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:57.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:58.144 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:58.140+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:58.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:58.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:59.159 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:29:59.156+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:29:59.283 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:29:59.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:00.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:00.164+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:00.304 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:00.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:01.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:01.192+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:01.273 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:01.268+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:02.200 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:02.196+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:02.300 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:02.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:03.227 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:03.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:03.284 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:03.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:04.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:04.264+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:04.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:04.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:05.234 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:05.232+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:05.246 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:05.240+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:06.253 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:06.248+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:06.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:06.252+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:07.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:07.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:07.293 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:07.288+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:08.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:08.260+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:08.264 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:08.260+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:09.222 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:09.220+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:09.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:09.224+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:10.189 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:10.184+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:10.247 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:10.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:11.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:11.152+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:11.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:11.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:12.128 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:12.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:12.229 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:12.224+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:13.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:13.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:13.186 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:13.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:14.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:14.056+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:14.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:14.132+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:14.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:30:14.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:30:14.928 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:30:14.938 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":5997,"stamp":"2024-09-16T14:30:14.729372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003223"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11028,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:27.944555+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:25:27.944555+0000","last_peered":"2024-09-16T14:25:27.944555+0000","last_clean":"2024-09-16T14:25:27.944555+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:25:27.944555+0000","last_undegraded":"2024-09-16T14:25:27.944555+0000","last_fullsized":"2024-09-16T14:25:27.944555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 164s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10714,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:34.053958+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:25:34.053958+0000","last_peered":"2024-09-16T14:25:34.053958+0000","last_clean":"2024-09-16T14:25:34.053958+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:25:34.053958+0000","last_undegraded":"2024-09-16T14:25:34.053958+0000","last_fullsized":"2024-09-16T14:25:34.053958+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 158s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12543,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:25:49.257236+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:25:49.257236+0000","last_peered":"2024-09-16T14:25:49.257236+0000","last_clean":"2024-09-16T14:25:49.257236+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:25:49.257236+0000","last_undegraded":"2024-09-16T14:25:49.257236+0000","last_fullsized":"2024-09-16T14:25:49.257236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740705,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.443,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.622,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.497},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.51900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.56699999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.627},"min":{"1min":0.54100000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.878},"last":0.60699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740709,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.58299999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.71999999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53400000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.68600000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.504},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.59299999999999997,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.875},"last":0.61399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740710,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.72399999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.02,"15min":1.02},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.53400000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:30:14.939 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:14.940 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:14.940 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:14.940 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:30:15.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:15.104+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:15.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:15.172+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:15.231 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:30:15.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:30:15.534 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:30:15.550 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:30:15.835 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:30:15.849 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:30:16.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:16.088+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:16.185 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:16.180+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:17.113 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:17.108+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:17.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:17.216+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:18.130 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:18.124+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:18.192 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:18.188+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:19.133 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:19.128+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:19.206 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:19.200+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:20.132 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:20.127+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:20.196 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:20.191+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:21.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:21.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:21.151 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:21.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:22.109 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:22.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:22.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:22.147+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:23.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:23.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:23.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:23.135+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:24.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:24.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:24.189 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:24.183+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:25.033 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:25.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:25.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:25.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:26.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:26.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:26.147 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:26.143+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:27.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:27.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:27.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:27.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:28.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:28.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:28.124 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:28.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:29.078 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:29.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:29.164 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:29.159+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:30.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:30.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:30.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:30.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:31.070 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:31.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:31.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:31.215+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:32.062 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:32.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:32.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:32.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:33.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:33.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:33.243 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:33.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:34.094 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:34.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:34.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:34.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:35.066 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:35.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:35.322 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:35.319+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:35.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:30:36.103 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:36.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:36.143 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:30:36.146 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:30:36.156 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6007,"stamp":"2024-09-16T14:30:34.734604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740709,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.443,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.622,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.51900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.58799999999999997}]},{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70399999999999996,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.624,"15min":0.627},"min":{"1min":0.54100000000000004,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":0.878},"last":0.63}]}]},{"osd":1,"up_from":8,"seq":34359740713,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.58299999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.71999999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.68600000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.59299999999999997,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.875},"last":0.626}]}]},{"osd":0,"up_from":8,"seq":34359740714,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.72399999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.67300000000000004},"min":{"1min":0.51200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75600000000000001,"5min":1.02,"15min":1.02},"last":0.73999999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:29:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.436,"15min":0.436},"max":{"1min":0.73299999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.60999999999999999},"min":{"1min":0.53400000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76400000000000001,"15min":0.79700000000000004},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:30:36.157 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:36.157 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:36.158 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:36.158 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:30:36.299 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:36.295+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:37.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:37.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:37.254 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:37.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:38.032 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:38.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:38.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:38.223+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:39.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:39.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:39.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:39.199+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:40.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:40.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:40.255 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:40.251+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:41.023 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:41.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:41.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:41.267+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:42.039 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:42.035+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:42.281 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:42.275+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:43.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:43.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:43.310 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:43.303+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:44.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:44.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:44.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:44.299+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:45.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:45.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:45.336 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:45.331+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:46.104 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:46.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:46.349 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:46.343+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:47.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:47.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:47.311 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:47.307+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:48.073 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:48.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:48.319 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:48.315+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:49.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:49.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:49.317 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:49.311+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:50.108 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:50.103+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:50.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:50.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:51.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:51.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:51.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:51.255+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:52.071 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:52.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:52.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:52.239+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:53.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:53.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:53.277 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:53.271+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:54.118 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:54.111+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:54.296 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:54.291+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:55.099 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:55.095+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:55.343 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:55.339+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:56.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:56.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:56.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:30:56.393 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:56.387+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:56.462 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:30:56.465 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:30:56.475 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6017,"stamp":"2024-09-16T14:30:54.740213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003147"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740713,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.443,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.622,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.51900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.58399999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.878},"last":0.71999999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740717,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.58299999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.71999999999999997,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:30:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.68600000000000005,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.64900000000000002,"15min":0.66000000000000003},"min":{"1min":0.59299999999999997,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.74099999999999999,"5min":0.80800000000000005,"15min":0.875},"last":0.60999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740718,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.56000000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.02},"last":0.63700000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.79700000000000004},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:30:56.476 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:56.476 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:56.477 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:30:56.477 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:30:57.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:57.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:57.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:57.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:58.057 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:58.051+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:58.436 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:58.431+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:59.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:30:59.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:30:59.442 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:30:59.439+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:00.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:00.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:00.449 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:00.443+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:01.067 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:01.063+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:01.456 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:01.451+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:02.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:02.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:02.483 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:02.479+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:03.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:03.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:03.479 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:03.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:04.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:04.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:04.470 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:04.467+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:05.084 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:05.079+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:05.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:05.475+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:06.105 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:06.099+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:06.525 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:06.519+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:07.072 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:07.067+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:07.529 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:07.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:08.060 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:08.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:08.578 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:08.575+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:09.093 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:09.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:09.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:09.527+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:10.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:10.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:10.530 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:10.523+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:11.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:11.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:11.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:11.567+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:12.087 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:12.083+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:12.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:12.599+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:13.091 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:13.087+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:13.647 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:13.643+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:14.111 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:14.107+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:14.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:14.611+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:15.069 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:15.062+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:15.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:15.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:16.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:16.058+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:16.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:31:16.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:16.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:16.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:31:16.781 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:31:16.791 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6028,"stamp":"2024-09-16T14:31:16.746336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003434"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740717,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:30:13 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.443,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.622,"5min":0.70699999999999996,"15min":0.71799999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.51900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.56899999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.878},"last":0.65600000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740721,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.60999999999999999,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.875},"last":0.5}]}]},{"osd":0,"up_from":8,"seq":34359740722,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.56000000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.02},"last":0.64300000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.79700000000000004},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:31:16.793 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:16.793 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:16.793 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:16.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:31:17.075 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:17.070+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:17.605 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:17.598+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:18.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:18.114+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:18.579 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:18.574+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:19.092 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:19.086+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:19.594 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:19.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:20.056 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:20.050+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:20.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:20.550+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:21.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:21.010+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:21.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:21.542+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:22.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:22.006+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:22.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:22.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:23.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:22.998+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:23.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:23.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:24.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:24.006+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:24.493 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:24.486+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:25.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:25.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:25.521 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:25.514+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:26.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:26.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:26.484 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:26.478+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:27.018 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:27.014+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:27.441 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:27.434+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:28.028 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:28.022+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:28.460 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:28.454+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:29.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:29.046+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:29.432 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:29.426+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:30.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:30.018+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:30.410 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:30.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:31.044 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:31.038+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:31.444 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:31.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:32.095 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:32.090+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:32.469 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:32.462+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:33.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:33.142+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:33.480 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:33.474+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:34.123 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:34.118+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:34.476 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:34.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:35.143 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:35.138+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:35.475 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:35.470+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:36.127 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:36.122+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:36.508 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:36.502+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:36.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:31:37.084 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:31:37.087 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:31:37.098 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6038,"stamp":"2024-09-16T14:31:36.752058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740721,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.71699999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.751},"last":0.63500000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.76400000000000001,"15min":0.83899999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.56599999999999995,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.878},"last":0.70399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740725,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56200000000000006}]},{"osd":2,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.60999999999999999,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.875},"last":0.629}]}]},{"osd":0,"up_from":8,"seq":34359740726,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53700000000000003,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.67200000000000004},"min":{"1min":0.56000000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.02},"last":0.70499999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.58999999999999997},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.42899999999999999,"15min":0.41799999999999998},"max":{"1min":0.68000000000000005,"5min":0.73799999999999999,"15min":0.79700000000000004},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:31:37.100 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:37.100 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:37.100 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:37.100 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:31:37.164 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:37.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:37.487 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:37.482+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:38.188 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:38.182+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:38.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:38.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:39.168 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:39.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:39.488 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:39.482+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:40.139 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:40.134+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:40.448 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:40.442+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:41.154 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:41.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:41.404 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:41.398+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:42.155 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:42.150+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:42.428 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:42.422+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:43.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:43.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:43.412 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:43.406+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:44.212 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:44.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:44.443 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:44.438+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:45.167 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:45.162+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:45.452 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:45.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:46.172 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:46.166+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:46.481 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:46.474+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:47.196 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:47.190+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:47.453 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:47.446+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:48.226 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:48.218+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:48.471 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:48.466+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:49.207 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:49.202+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:49.482 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:49.478+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:50.220 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:50.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:50.533 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:50.526+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:51.262 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:51.258+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:51.560 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:51.554+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:52.257 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:52.250+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:52.554 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:52.546+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:53.219 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:53.214+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:53.577 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:53.570+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:54.247 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:54.242+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:54.592 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:54.586+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:55.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:55.266+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:55.607 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:55.602+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:56.275 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:56.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:56.570 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:56.562+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:57.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:31:57.310 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:57.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:57.399 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:31:57.401 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:31:57.416 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6048,"stamp":"2024-09-16T14:31:56.757571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003389"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740725,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.71699999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.751},"last":0.65100000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.80100000000000005,"15min":0.878},"last":0.61099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740729,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.42699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:31:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.47199999999999998,"5min":0.45700000000000002,"15min":0.441},"max":{"1min":0.74099999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.65500000000000003,"15min":0.65900000000000003},"min":{"1min":0.60999999999999999,"5min":0.51600000000000001,"15min":0.504},"max":{"1min":0.78100000000000003,"5min":0.80800000000000005,"15min":0.875},"last":0.67000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740730,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":0.76200000000000001,"15min":1.02},"last":0.72699999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.68500000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.47499999999999998,"15min":0.41799999999999998},"max":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:31:57.417 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:57.417 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:57.418 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:31:57.418 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:31:57.617 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:57.610+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:58.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:58.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:58.644 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:58.638+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:59.299 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:31:59.294+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:31:59.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:31:59.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:00.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:00.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:00.621 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:00.614+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:01.367 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:01.362+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:01.672 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:01.666+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:02.325 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:02.318+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:02.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:02.626+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:03.309 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:03.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:03.626 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:03.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:04.308 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:04.302+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:04.586 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:04.578+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:05.315 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:05.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:05.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:05.594+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:06.353 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:06.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:06.628 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:06.622+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:07.318 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:07.314+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:07.651 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:07.646+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:08.351 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:08.346+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:08.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:08.637+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:09.390 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:09.381+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:09.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:09.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:10.439 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:10.433+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:10.646 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:10.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:11.475 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:11.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:11.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:11.661+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:12.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:12.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:12.648 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:12.641+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:13.512 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:13.505+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:13.650 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:13.645+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:14.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:14.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:14.639 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:14.633+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:15.480 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:15.473+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:15.643 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:15.637+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:16.519 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:16.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:16.632 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:16.625+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:17.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:32:17.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:17.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:17.584 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:17.577+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:17.720 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:32:17.723 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:32:17.734 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6058,"stamp":"2024-09-16T14:32:16.762995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003322"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11029,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.433841+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:28:12.433841+0000","last_peered":"2024-09-16T14:28:12.433841+0000","last_clean":"2024-09-16T14:28:12.433841+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:28:12.433841+0000","last_undegraded":"2024-09-16T14:28:12.433841+0000","last_fullsized":"2024-09-16T14:28:12.433841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 287s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10715,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:12.732468+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:28:12.732468+0000","last_peered":"2024-09-16T14:28:12.732468+0000","last_clean":"2024-09-16T14:28:12.732468+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:28:12.732468+0000","last_undegraded":"2024-09-16T14:28:12.732468+0000","last_fullsized":"2024-09-16T14:28:12.732468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 281s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12544,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:28:13.037028+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:28:13.037028+0000","last_peered":"2024-09-16T14:28:13.037028+0000","last_clean":"2024-09-16T14:28:13.037028+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:28:13.037028+0000","last_undegraded":"2024-09-16T14:28:13.037028+0000","last_fullsized":"2024-09-16T14:28:13.037028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 266s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740729,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:31:16 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.66000000000000003,"5min":0.70699999999999996,"15min":0.71699999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.315},"max":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.751},"last":0.58099999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.80100000000000005,"15min":0.878},"last":0.63400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740733,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.626},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.73999999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":0.875},"last":0.81799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740734,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":0.76200000000000001,"15min":1.02},"last":0.621}]},{"osd":2,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.68500000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.47499999999999998,"15min":0.41799999999999998},"max":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:32:17.735 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:17.735 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:17.736 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:17.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:32:18.023 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:32:18.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:32:18.324 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:32:18.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:32:18.505 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:18.497+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:18.611 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:32:18.625 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:32:18.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:18.625+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:19.500 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:19.493+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:19.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:19.613+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:20.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:20.449+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:20.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:20.593+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:21.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:21.437+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:21.635 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:21.629+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:22.401 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:22.393+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:22.606 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:22.601+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:23.423 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:23.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:23.602 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:23.597+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:24.380 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:24.373+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:24.576 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:24.569+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:25.377 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:25.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:25.531 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:25.525+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:26.349 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:26.341+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:26.582 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:26.573+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:27.375 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:27.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:27.561 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:27.553+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:28.376 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:28.369+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:28.595 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:28.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:29.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:29.361+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:29.563 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:29.557+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:30.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:30.413+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:30.589 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:30.581+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:31.408 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:31.401+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:31.546 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:31.541+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:32.391 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:32.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:32.598 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:32.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:33.415 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:33.409+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:33.568 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:33.561+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:34.394 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:34.389+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:34.557 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:34.549+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:35.393 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:35.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:35.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:35.597+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:36.435 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:36.429+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:36.596 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:36.589+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:37.425 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:37.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:37.622 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:37.617+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:38.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:38.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:38.604 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:38.597+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:38.627 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:32:38.924 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:32:38.927 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:32:38.941 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6069,"stamp":"2024-09-16T14:32:38.769064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003310"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740733,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:31:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.80100000000000005,"15min":0.878},"last":0.55700000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740737,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.60499999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":0.875},"last":0.66900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740738,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53200000000000003,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.748,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.70699999999999996,"5min":0.76200000000000001,"15min":1.02},"last":0.67600000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:31:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.49299999999999999,"5min":0.45400000000000001,"15min":0.436},"max":{"1min":0.68500000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.503,"5min":0.47499999999999998,"15min":0.41799999999999998},"max":{"1min":0.70499999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.55900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:32:38.943 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:38.943 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:38.943 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:38.944 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:32:39.429 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:39.421+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:39.645 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:39.637+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:40.464 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:40.457+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:40.660 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:40.653+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:41.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:41.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:41.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:41.673+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:42.392 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:42.385+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:42.661 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:42.653+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:43.424 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:43.417+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:43.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:43.693+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:44.456 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:44.449+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:44.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:44.741+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:45.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:45.469+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:45.708 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:45.701+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:46.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:46.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:46.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:46.705+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:47.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:47.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:47.666 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:47.657+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:48.565 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:48.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:48.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:48.673+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:49.552 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:49.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:49.687 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:49.681+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:50.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:50.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:50.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:50.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:51.526 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:51.521+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:51.700 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:51.697+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:52.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:52.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:52.715 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:52.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:53.529 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:53.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:53.691 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:53.689+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:54.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:54.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:54.668 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:54.665+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:55.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:55.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:55.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:55.709+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:56.634 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:56.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:56.752 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:56.749+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:57.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:57.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:57.789 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:57.785+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:58.643 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:58.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:58.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:58.765+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:58.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:32:59.243 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:32:59.246 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:32:59.259 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6079,"stamp":"2024-09-16T14:32:58.774590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740737,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.66000000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.878},"last":0.63300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740741,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51200000000000001,"15min":0.51900000000000002},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61199999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.623,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:32:09 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67500000000000004,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.73299999999999998,"5min":0.80800000000000005,"15min":0.875},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740742,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.67500000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.50600000000000001,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.66700000000000004,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:32:59.261 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:59.261 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:59.261 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:32:59.261 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:32:59.606 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:32:59.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:32:59.763 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:32:59.761+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:00.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:00.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:00.768 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:00.765+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:01.556 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:01.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:01.802 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:01.801+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:02.535 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:02.532+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:02.755 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:02.752+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:03.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:03.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:03.754 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:03.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:04.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:04.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:04.716 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:04.712+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:05.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:05.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:05.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:05.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:06.648 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:06.644+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:06.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:06.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:07.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:07.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:07.742 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:07.740+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:08.661 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:08.656+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:08.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:08.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:09.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:09.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:09.688 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:09.684+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:10.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:10.612+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:10.723 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:10.720+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:11.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:11.660+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:11.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:11.684+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:12.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:12.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:12.706 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:12.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:13.613 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:13.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:13.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:13.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:14.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:14.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:14.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:14.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:15.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:15.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:15.695 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:15.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:16.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:16.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:16.714 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:16.708+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:17.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:17.668+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:17.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:17.760+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:18.640 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:18.636+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:18.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:18.740+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:19.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:33:19.563 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:33:19.566 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:33:19.576 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6089,"stamp":"2024-09-16T14:33:18.780204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003371"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740741,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:32:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.315},"max":{"1min":0.65400000000000003,"5min":0.73299999999999998,"15min":0.751},"last":0.60099999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.878},"last":0.65700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740745,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.626,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.63400000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.875},"last":0.70899999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740746,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.625}]},{"osd":2,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.50600000000000001,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.66700000000000004,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:33:19.577 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:19.577 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:19.578 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:19.578 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:33:19.637 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:19.632+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:19.710 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:19.704+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:20.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:20.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:20.673 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:20.668+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:21.598 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:21.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:21.680 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:21.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:22.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:22.560+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:22.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:22.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:23.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:23.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:23.690 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:23.684+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:24.584 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:24.580+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:24.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:24.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:25.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:25.620+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:25.698 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:25.692+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:26.595 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:26.592+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:26.654 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:26.652+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:27.619 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:27.616+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:27.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:27.628+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:28.662 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:28.656+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:28.680 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:28.676+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:29.631 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:29.628+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:29.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:29.652+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:30.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:30.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:30.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:30.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:31.573 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:31.568+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:31.701 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:31.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:32.611 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:32.608+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:32.685 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:32.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:33.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:33.604+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:33.735 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:33.732+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:34.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:34.596+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:34.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:34.744+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:35.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:35.640+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:35.751 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:35.748+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:36.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:36.692+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:36.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:36.768+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:37.709 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:37.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:37.823 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:37.820+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:38.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:38.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:38.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:38.868+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:39.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:33:39.713 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:39.708+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:39.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:33:39.878 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:33:39.880 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:39.876+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:39.891 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6099,"stamp":"2024-09-16T14:33:38.785699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003281"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740745,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.432,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.751},"last":0.57599999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.68400000000000005,"5min":0.71299999999999997,"15min":0.83899999999999997},"last":0.629},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63300000000000001,"15min":0.629},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.878},"last":0.67400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740749,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.626,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.63200000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.875},"last":0.71699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740750,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.67100000000000004},"min":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.76400000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:32:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59599999999999997,"15min":0.60499999999999998},"min":{"1min":0.50600000000000001,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.66700000000000004,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:33:39.893 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:39.893 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:39.893 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:33:39.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:33:40.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:40.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:40.932 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:40.928+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:41.739 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:41.736+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:41.929 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:41.924+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:42.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:42.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:42.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:42.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:43.795 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:43.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:43.947 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:43.944+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:44.796 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:44.792+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:44.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:44.908+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:45.765 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:45.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:45.915 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:45.912+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:46.731 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:46.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:46.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:46.952+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:47.727 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:47.724+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:47.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:47.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:48.715 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:48.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:48.938 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:48.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:49.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:49.688+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:49.940 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:49.936+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:50.737 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:50.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:50.965 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:50.960+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:51.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:51.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:51.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:51.940+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:52.772 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:52.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:52.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:52.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:53.771 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:53.768+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:53.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:53.964+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:54.752 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:54.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:54.983 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:54.980+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:55.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:55.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:56.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:55.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:56.742 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:56.739+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:57.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:57.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:57.780 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:57.775+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:58.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:58.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:58.760 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:58.755+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:59.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:59.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:59.792 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:33:59.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:33:59.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:33:59.967 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:33:59.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:00.190 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:34:00.193 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:34:00.203 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6109,"stamp":"2024-09-16T14:33:58.791002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003103"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.432,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.751},"last":0.60999999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:33:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.83899999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.878},"last":0.65700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740753,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.626,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.47399999999999998},"max":{"1min":0.76000000000000001,"5min":0.84499999999999997,"15min":0.97899999999999998},"last":0.63800000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.5,"15min":0.5},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.875},"last":0.71099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740754,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":0.70399999999999996,"5min":1.022,"15min":1.022},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:34:00.204 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:00.204 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:00.204 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:00.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:34:00.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:00.747+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:00.961 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:00.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:01.793 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:01.787+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:01.922 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:01.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:02.802 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:02.799+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:02.899 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:02.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:03.851 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:03.847+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:03.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:03.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:04.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:04.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:04.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:04.891+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:05.875 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:05.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:05.876 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:05.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:06.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:06.823+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:06.860 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:06.855+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:07.840 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:07.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:07.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:07.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:08.842 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:08.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:08.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:08.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:09.854 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:09.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:09.857 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:09.851+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:10.869 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:10.863+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:10.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:10.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:11.915 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:11.911+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:11.917 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:11.911+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:12.901 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:12.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:12.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:12.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:13.872 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:13.867+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:13.977 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:13.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:14.893 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:14.887+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:15.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:15.023+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:15.877 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:15.871+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:16.074 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:16.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:16.888 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:16.883+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:17.042 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:17.035+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:17.908 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:17.903+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:18.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:18.051+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:18.896 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:18.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:19.009 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:19.003+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:19.897 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:19.891+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:19.968 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:19.963+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:20.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:34:20.503 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:34:20.506 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:34:20.516 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6119,"stamp":"2024-09-16T14:34:18.796647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003329"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11030,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.225610+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:30:15.225610+0000","last_peered":"2024-09-16T14:30:15.225610+0000","last_clean":"2024-09-16T14:30:15.225610+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:30:15.225610+0000","last_undegraded":"2024-09-16T14:30:15.225610+0000","last_fullsized":"2024-09-16T14:30:15.225610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 410s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10716,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.529840+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:30:15.529840+0000","last_peered":"2024-09-16T14:30:15.529840+0000","last_clean":"2024-09-16T14:30:15.529840+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:30:15.529840+0000","last_undegraded":"2024-09-16T14:30:15.529840+0000","last_fullsized":"2024-09-16T14:30:15.529840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 404s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12545,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:30:15.829035+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:30:15.829035+0000","last_peered":"2024-09-16T14:30:15.829035+0000","last_clean":"2024-09-16T14:30:15.829035+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:30:15.829035+0000","last_undegraded":"2024-09-16T14:30:15.829035+0000","last_fullsized":"2024-09-16T14:30:15.829035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 389s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740753,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:33:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53800000000000003,"15min":0.53200000000000003},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.65300000000000002,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.48099999999999998,"5min":0.432,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.72399999999999998,"15min":0.751},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:33:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.83899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.878},"last":0.61099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740757,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.42599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.628,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48499999999999999},"max":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.622}]},{"osd":2,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.52100000000000002,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.75,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.61299999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.875},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740758,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.73399999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":0.70399999999999996,"5min":1.022,"15min":1.022},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:34:20.518 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:20.518 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:20.518 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:20.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:34:20.807 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:34:20.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:34:20.900 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:20.895+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:20.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:20.971+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:21.108 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:34:21.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:34:21.413 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:34:21.427 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:34:21.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:21.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:21.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:21.959+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:22.921 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:22.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:23.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:22.999+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:23.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:23.915+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:24.011 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:24.007+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:24.941 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:24.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:24.996 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:24.991+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:25.940 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:25.935+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:26.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:26.015+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:26.970 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:26.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:27.035 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:27.031+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:27.947 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:27.943+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:28.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:28.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:28.975 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:28.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:29.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:29.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:30.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:30.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:30.092 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:30.087+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:31.024 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:31.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:31.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:31.107+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:32.059 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:32.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:32.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:32.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:33.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:33.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:33.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:33.111+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:34.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:34.067+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:34.124 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:34.119+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:35.051 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:35.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:35.137 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:35.131+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:36.076 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:36.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:36.146 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:36.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:37.080 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:37.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:37.181 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:37.175+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:38.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:38.059+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:38.157 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:38.151+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:39.033 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:39.027+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:39.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:39.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:40.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:40.055+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:40.205 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:40.199+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:41.053 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:41.047+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:41.241 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:41.235+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:41.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:34:41.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:34:41.724 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:34:41.734 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6130,"stamp":"2024-09-16T14:34:40.802844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003426"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740758,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.315},"max":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.746},"last":0.46600000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:33:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.34599999999999997},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.83899999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63500000000000001,"15min":0.63},"min":{"1min":0.56000000000000005,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.878},"last":0.55000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740762,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.42599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.628,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.437},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48499999999999999},"max":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.52100000000000002,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.75,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.61299999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.875},"last":0.65900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740763,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.39500000000000002,"15min":0.251},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.55200000000000005,"5min":0.51200000000000001,"15min":0.34100000000000003},"max":{"1min":0.76400000000000001,"5min":0.76600000000000001,"15min":1.02},"last":0.625}]},{"osd":2,"last update":"Mon Sep 16 14:33:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.495,"5min":0.46100000000000002,"15min":0.436},"max":{"1min":0.70399999999999996,"5min":1.022,"15min":1.022},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.504,"5min":0.497,"15min":0.41799999999999998},"max":{"1min":0.70299999999999996,"5min":0.73399999999999999,"15min":0.79700000000000004},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:34:41.735 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:41.735 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:41.736 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:34:41.736 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:34:42.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:42.071+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:42.265 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:42.259+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:43.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:43.091+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:43.236 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:43.231+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:44.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:44.063+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:44.197 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:44.191+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:45.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:45.079+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:45.170 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:45.163+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:46.082 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:46.075+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:46.147 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:46.143+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:47.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:47.123+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:47.187 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:47.183+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:48.125 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:48.119+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:48.224 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:48.219+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:49.106 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:49.099+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:49.194 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:49.187+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:50.148 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:50.142+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:50.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:50.230+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:51.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:51.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:51.281 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:51.274+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:52.137 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:52.130+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:52.274 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:52.270+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:53.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:53.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:53.261 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:53.254+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:54.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:54.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:54.270 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:54.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:55.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:55.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:55.285 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:55.278+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:56.227 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:56.222+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:56.291 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:56.286+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:57.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:57.242+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:57.317 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:57.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:58.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:58.254+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:58.319 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:58.314+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:59.225 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:34:59.218+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:34:59.316 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:34:59.310+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:00.182 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:00.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:00.362 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:00.358+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:01.210 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:01.202+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:01.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:01.362+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:01.737 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:35:02.035 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:35:02.038 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:35:02.048 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6140,"stamp":"2024-09-16T14:35:00.808234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003284"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740762,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.315},"max":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.746},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:34:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.504},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.496,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58299999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740766,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.42599999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.628,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61899999999999999},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48499999999999999},"max":{"1min":0.77200000000000002,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:34:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.52100000000000002,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.75,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66300000000000003,"15min":0.65900000000000003},"min":{"1min":0.61299999999999999,"5min":0.5,"15min":0.5},"max":{"1min":0.80600000000000005,"5min":0.81799999999999995,"15min":0.875},"last":0.60099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740767,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.746,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.02},"last":0.70299999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.746,"5min":1.022,"15min":1.022},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:35:02.050 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:02.050 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:02.050 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:02.050 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:35:02.202 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:02.198+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:02.341 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:02.334+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:03.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:03.194+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:03.346 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:03.338+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:04.194 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:04.190+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:04.357 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:04.350+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:05.184 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:05.178+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:05.369 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:05.362+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:06.155 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:06.150+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:06.420 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:06.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:07.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:07.122+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:07.427 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:07.422+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:08.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:08.138+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:08.467 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:08.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:09.109 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:09.102+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:09.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:09.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:10.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:10.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:10.481 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:10.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:11.048 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:11.042+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:11.468 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:11.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:12.083 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:12.078+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:12.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:12.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:13.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:13.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:13.490 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:13.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:14.044 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:14.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:14.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:14.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:15.057 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:15.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:15.489 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:15.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:16.039 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:16.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:16.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:16.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:17.063 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:17.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:17.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:17.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:18.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:18.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:18.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:18.530+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:19.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:19.006+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:19.541 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:19.534+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:20.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:20.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:20.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:20.578+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:21.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:21.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:21.597 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:21.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:22.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:35:22.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:22.062+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:22.349 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:35:22.352 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:35:22.362 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6150,"stamp":"2024-09-16T14:35:20.813699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740766,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:34:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.53400000000000003},"min":{"1min":0.46600000000000003,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.505,"5min":0.432,"15min":0.315},"max":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.746},"last":0.66500000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:34:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.496,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63}]}]},{"osd":1,"up_from":8,"seq":34359740770,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.73799999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.498,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67400000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.875},"last":0.63500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740771,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.746,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.02},"last":0.64900000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.746,"5min":1.022,"15min":1.022},"last":0.505},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:35:22.363 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:22.364 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:22.364 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:22.364 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:35:22.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:22.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:23.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:23.030+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:23.601 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:23.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:24.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:24.058+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:24.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:24.638+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:25.070 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:25.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:25.621 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:25.614+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:26.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:26.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:26.617 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:26.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:27.025 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:27.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:27.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:27.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:28.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:28.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:28.594 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:28.590+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:29.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:29.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:29.576 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:29.570+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:29.976 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:29.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:30.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:30.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:31.019 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:31.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:31.599 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:31.594+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:32.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:32.050+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:32.604 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:32.598+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:33.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:33.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:33.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:33.610+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:34.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:34.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:34.659 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:34.654+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:34.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:34.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:35.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:35.662+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:35.958 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:35.954+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:36.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:36.630+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:36.989 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:36.982+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:37.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:37.622+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:37.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:37.966+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:38.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:38.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:38.964 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:38.958+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:39.608 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:39.602+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:39.939 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:39.934+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:40.572 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:40.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:40.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:40.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:41.588 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:41.582+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:41.966 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:41.962+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:42.365 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:35:42.631 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:42.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:42.661 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:35:42.664 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:35:42.674 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6160,"stamp":"2024-09-16T14:35:40.819302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003420"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740770,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:25 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.58599999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.46300000000000002,"5min":0.432,"15min":0.315},"max":{"1min":0.66500000000000004,"5min":0.72399999999999998,"15min":0.746},"last":0.63300000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:34:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.496,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59199999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740774,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.73799999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.64400000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.498,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67400000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.875},"last":0.72099999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740775,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.54400000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.746,"5min":0.80600000000000005,"15min":0.81699999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":1.02},"last":0.71299999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:34:51 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.746,"5min":1.022,"15min":1.022},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:35:42.675 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:42.675 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:42.676 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:35:42.676 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:35:42.933 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:42.925+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:43.646 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:43.641+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:43.981 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:43.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:44.607 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:44.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:45.003 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:44.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:45.630 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:45.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:46.016 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:46.009+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:46.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:46.597+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:47.066 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:47.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:47.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:47.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:48.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:48.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:48.546 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:48.537+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:49.104 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:49.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:49.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:49.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:50.097 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:50.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:50.610 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:50.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:51.069 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:51.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:51.641 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:51.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:52.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:52.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:52.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:52.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:53.022 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:53.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:53.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:53.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:54.067 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:54.061+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:54.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:54.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:55.093 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:55.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:55.711 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:55.705+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:56.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:56.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:56.681 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:56.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:57.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:57.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:57.706 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:57.697+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:58.085 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:58.077+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:58.720 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:58.713+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:59.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:35:59.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:35:59.730 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:35:59.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:00.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:00.113+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:00.724 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:00.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:01.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:01.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:01.710 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:01.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:02.146 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:02.141+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:02.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:36:02.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:02.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:02.970 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:36:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:36:02.982 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6171,"stamp":"2024-09-16T14:36:02.825241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740774,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:25 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.58599999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.46300000000000002,"5min":0.432,"15min":0.315},"max":{"1min":0.66500000000000004,"5min":0.72399999999999998,"15min":0.746},"last":0.66700000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:35:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.752,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.504}]}]},{"osd":1,"up_from":8,"seq":34359740778,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.73799999999999999,"5min":0.76800000000000002,"15min":0.78200000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73599999999999999,"5min":0.78100000000000003,"15min":0.97899999999999998},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:35:12 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57299999999999995},"min":{"1min":0.498,"5min":0.44900000000000001,"15min":0.441},"max":{"1min":0.67400000000000004,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66100000000000003,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.74299999999999999,"5min":0.81799999999999995,"15min":0.875},"last":0.60099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740779,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.42299999999999999,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.624},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":1.02},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":1.022,"15min":1.022},"last":0.495},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:36:02.983 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:02.983 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:02.984 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:02.984 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:36:03.154 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:03.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:03.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:03.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:04.127 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:04.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:04.674 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:04.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:05.102 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:05.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:05.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:05.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:06.138 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:06.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:06.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:06.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:07.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:07.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:07.587 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:07.581+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:08.187 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:08.181+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:08.548 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:08.541+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:09.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:09.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:09.537 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:09.529+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:10.263 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:10.257+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:10.523 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:10.517+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:11.250 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:11.245+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:11.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:11.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:12.203 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:12.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:12.557 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:12.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:13.204 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:13.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:13.566 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:13.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:14.220 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:14.213+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:14.582 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:14.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:15.177 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:15.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:15.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:15.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:16.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:16.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:16.636 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:16.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:17.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:17.133+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:17.667 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:17.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:18.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:18.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:18.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:18.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:19.135 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:19.129+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:19.683 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:19.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:20.152 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:20.145+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:20.642 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:20.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:21.173 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:21.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:21.688 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:21.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:22.190 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:22.185+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:22.645 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:22.637+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:22.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:36:23.176 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:23.169+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:23.276 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:36:23.279 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:36:23.289 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6181,"stamp":"2024-09-16T14:36:22.830512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003243"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11031,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.018649+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:32:18.018649+0000","last_peered":"2024-09-16T14:32:18.018649+0000","last_clean":"2024-09-16T14:32:18.018649+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:32:18.018649+0000","last_undegraded":"2024-09-16T14:32:18.018649+0000","last_fullsized":"2024-09-16T14:32:18.018649+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 532s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10717,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.317257+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:32:18.317257+0000","last_peered":"2024-09-16T14:32:18.317257+0000","last_clean":"2024-09-16T14:32:18.317257+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:32:18.317257+0000","last_undegraded":"2024-09-16T14:32:18.317257+0000","last_fullsized":"2024-09-16T14:32:18.317257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 527s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12546,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:32:18.605668+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:32:18.605668+0000","last_peered":"2024-09-16T14:32:18.605668+0000","last_clean":"2024-09-16T14:32:18.605668+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:32:18.605668+0000","last_undegraded":"2024-09-16T14:32:18.605668+0000","last_fullsized":"2024-09-16T14:32:18.605668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 512s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740778,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:35:25 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39400000000000002,"15min":0.28199999999999997},"max":{"1min":0.58599999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57099999999999995,"15min":0.57999999999999996},"min":{"1min":0.46300000000000002,"5min":0.432,"15min":0.315},"max":{"1min":0.66500000000000004,"5min":0.72399999999999998,"15min":0.746},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:35:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.752,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740782,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.621},"min":{"1min":0.53500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.97899999999999998},"last":0.68999999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.67800000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.627},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.57299999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.875},"last":0.76400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740783,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.42299999999999999,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":1.02},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":1.022,"15min":1.022},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:36:23.291 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:23.291 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:23.291 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:23.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:36:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:36:23.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:36:23.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:23.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:23.870 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:36:23.880 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:36:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:36:24.172 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:24.165+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:24.183 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:36:24.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:24.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:25.201 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:25.197+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:25.673 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:25.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:26.214 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:26.209+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:26.694 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:26.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:27.219 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:27.217+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:27.689 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:27.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:28.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:28.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:28.721 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:28.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:29.271 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:29.269+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:29.685 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:29.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:30.245 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:30.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:30.664 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:30.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:31.286 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:31.285+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:31.696 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:31.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:32.242 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:32.241+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:32.700 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:32.697+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:33.237 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:33.233+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:33.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:33.729+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:34.282 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:34.281+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:34.725 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:34.721+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:35.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:35.265+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:35.719 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:35.717+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:36.266 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:36.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:36.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:36.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:37.285 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:37.280+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:37.762 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:37.756+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:38.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:38.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:38.732 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:38.728+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:39.212 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:39.208+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:39.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:39.732+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:40.259 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:40.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:40.702 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:40.696+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:41.305 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:41.300+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:41.745 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:41.740+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:42.258 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:42.256+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:42.718 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:42.716+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:43.270 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:43.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:43.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:43.684+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:44.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:36:44.267 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:44.264+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:44.482 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:36:44.485 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:36:44.495 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6191,"stamp":"2024-09-16T14:36:42.836285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003527"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740782,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.45400000000000001,"5min":0.39600000000000002,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.746},"last":0.53900000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:35:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.54300000000000004,"5min":0.49399999999999999,"15min":0.35399999999999998},"max":{"1min":0.752,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740786,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.621},"min":{"1min":0.53500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.97899999999999998},"last":0.65000000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.67800000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.57299999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.875},"last":0.57999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740787,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53400000000000003,"15min":0.54200000000000004},"min":{"1min":0.42299999999999999,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.55900000000000005,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.73499999999999999,"5min":0.80400000000000005,"15min":1.02},"last":0.66900000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:35:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":1.022,"15min":1.022},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.5,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68700000000000006,"5min":0.70799999999999996,"15min":0.79700000000000004},"last":0.64000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:36:44.497 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:44.497 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:44.497 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:36:44.497 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:36:44.717 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:44.712+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:45.248 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:45.244+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:45.726 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:45.720+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:46.276 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:46.272+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:46.764 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:46.760+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:47.302 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:47.296+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:47.751 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:47.748+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:48.345 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:48.340+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:48.708 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:48.704+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:49.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:49.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:49.757 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:49.752+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:50.295 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:50.292+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:50.789 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:50.784+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:51.330 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:51.328+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:51.835 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:51.832+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:52.357 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:52.352+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:52.863 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:52.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:53.359 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:53.356+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:53.824 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:53.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:54.366 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:54.364+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:54.822 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:54.820+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:55.381 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:55.376+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:55.866 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:55.860+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:56.419 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:56.416+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:56.846 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:56.840+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:57.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:57.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:57.891 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:57.888+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:58.437 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:58.432+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:58.927 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:58.924+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:59.465 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:36:59.460+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:36:59.961 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:36:59.956+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:00.486 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:00.484+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:01.001 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:00.996+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:01.520 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:01.516+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:01.955 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:01.952+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:02.485 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:02.480+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:02.919 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:02.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:03.524 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:03.520+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:03.922 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:03.916+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:04.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:37:04.562 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:04.560+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:04.800 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:37:04.802 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:37:04.811 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6201,"stamp":"2024-09-16T14:37:02.841738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740786,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.45400000000000001,"5min":0.39600000000000002,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.746},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Sep 16 14:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.495,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740790,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.621},"min":{"1min":0.53500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.97899999999999998},"last":0.52600000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:36:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.67800000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.57299999999999995,"5min":0.438,"15min":0.438},"max":{"1min":0.76400000000000001,"5min":0.81799999999999995,"15min":0.875},"last":0.55700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740791,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.752,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":1.02},"last":0.58199999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.53300000000000003,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.67400000000000004,"5min":1.022,"15min":1.022},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.502,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76400000000000001},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:37:04.813 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:04.813 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:04.813 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:04.814 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:37:04.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:04.968+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:05.599 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:05.596+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:05.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:05.964+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:06.616 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:06.612+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:07.010 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:07.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:07.649 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:07.644+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:07.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:07.968+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:08.634 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:08.632+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:08.973 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:08.968+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:09.675 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:09.672+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:10.006 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:10.004+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:10.684 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:10.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:10.981 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:10.976+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:11.699 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:11.696+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:12.029 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:12.024+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:12.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:12.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:13.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:13.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:13.689 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:13.684+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:14.083 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:14.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:14.669 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:14.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:15.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:15.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:15.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:15.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:16.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:16.008+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:16.681 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:16.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:17.051 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:17.048+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:17.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:17.676+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:18.085 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:18.080+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:18.667 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:18.664+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:19.100 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:19.096+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:19.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:19.652+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:20.089 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:20.084+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:20.686 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:20.680+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:21.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:21.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:21.719 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:21.716+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:22.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:22.040+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:22.704 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:22.700+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:23.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:23.036+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:23.693 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:23.688+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:24.054 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:24.052+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:24.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:24.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:24.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:37:25.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:25.032+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:25.109 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:37:25.111 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:37:25.121 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6212,"stamp":"2024-09-16T14:37:24.847423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003140"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:36:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.45400000000000001,"5min":0.39600000000000002,"15min":0.28199999999999997},"max":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.315},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.746},"last":0.52100000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.495,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56299999999999994}]}]},{"osd":1,"up_from":8,"seq":34359740795,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.66200000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.622},"min":{"1min":0.52600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57699999999999996},"min":{"1min":0.53900000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.69399999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.875},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740796,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.752,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":1.02},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.53300000000000003,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.67400000000000004,"5min":1.022,"15min":1.022},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.502,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76400000000000001},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:37:25.123 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:25.123 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:25.123 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:25.123 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:37:25.726 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:25.724+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:26.081 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:26.076+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:26.769 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:26.764+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:27.068 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:27.064+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:27.783 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:27.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:28.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:28.028+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:28.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:28.780+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:29.016 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:29.012+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:29.748 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:29.743+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:30.034 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:30.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:30.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:30.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:31.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:31.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:31.790 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:31.787+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:32.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:32.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:32.827 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:32.823+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:32.985 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:32.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:33.822 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:33.819+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:34.031 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:34.027+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:34.774 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:34.771+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:35.014 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:35.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:35.747 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:35.743+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:35.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:35.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:36.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:36.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:36.957 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:36.951+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:37.762 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:37.759+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:38.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:37.995+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:38.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:38.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:38.982 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:38.979+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:39.696 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:39.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:40.011 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:40.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:40.729 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:40.723+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:41.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:41.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:41.694 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:41.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:42.050 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:42.047+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:42.692 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:42.687+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:43.096 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:43.091+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:43.678 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:43.675+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:44.079 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:44.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:44.718 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:44.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:45.077 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:45.071+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:45.124 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:37:45.414 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:37:45.417 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:37:45.428 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6222,"stamp":"2024-09-16T14:37:44.852860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003404"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740795,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.746},"last":0.60399999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.495,"5min":0.42999999999999999,"15min":0.34599999999999997},"max":{"1min":0.71899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.622,"15min":0.629},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.73199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65800000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740799,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.66200000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.622},"min":{"1min":0.52600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.77900000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57699999999999996},"min":{"1min":0.53900000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.69399999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.875},"last":0.65400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740801,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.752,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.56699999999999995,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.71799999999999997,"5min":0.80400000000000005,"15min":1.02},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:36:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.53300000000000003,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.67400000000000004,"5min":1.022,"15min":1.022},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.502,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76400000000000001},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:37:45.429 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:45.429 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:45.430 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:37:45.430 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:37:45.682 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:45.679+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:46.080 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:46.075+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:46.711 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:46.707+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:47.058 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:47.055+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:47.722 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:47.719+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:48.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:48.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:48.744 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:48.739+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:48.972 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:48.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:49.721 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:49.715+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:49.965 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:49.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:50.679 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:50.675+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:50.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:50.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:51.656 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:51.651+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:51.942 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:51.939+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:52.697 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:52.691+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:52.962 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:52.959+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:53.745 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:53.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:54.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:53.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:54.772 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:54.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:55.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:55.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:55.738 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:55.735+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:55.994 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:55.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:56.727 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:56.723+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:56.954 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:56.947+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:57.770 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:57.767+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:57.969 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:57.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:58.799 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:58.795+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:58.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:58.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:37:59.847 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:37:59.843+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:00.003 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:37:59.999+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:00.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:00.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:00.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:00.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:01.876 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:01.871+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:01.971 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:01.967+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:02.925 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:02.919+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:03.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:03.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:03.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:03.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:03.978 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:03.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:04.951 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:04.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:04.980 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:04.975+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:05.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:38:05.724 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:38:05.727 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:38:05.737 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6232,"stamp":"2024-09-16T14:38:04.858112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740799,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.746},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.49199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740803,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.443,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.66200000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.628,"15min":0.622},"min":{"1min":0.52600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:37:17 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57699999999999996},"min":{"1min":0.53900000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.69399999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.52900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.875},"last":0.66300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740805,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.54500000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.753,"5min":0.80400000000000005,"15min":1.02},"last":0.67800000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":1.022},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.76400000000000001},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:38:05.738 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:05.739 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:05.739 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:05.739 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:38:05.959 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:05.955+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:06.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:06.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:07.001 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:06.995+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:07.015 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:07.011+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:07.954 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:07.951+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:07.967 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:07.963+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:08.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:08.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:09.009 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:09.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:09.900 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:09.895+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:10.020 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:10.015+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:10.853 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:10.847+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:10.997 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:10.991+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:11.855 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:11.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:11.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:11.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:12.856 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:12.851+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:13.025 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:13.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:13.841 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:13.835+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:14.043 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:14.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:14.891 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:14.887+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:15.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:15.031+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:15.930 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:15.927+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:16.007 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:16.003+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:16.921 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:16.915+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:16.977 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:16.971+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:17.945 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:17.939+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:18.022 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:18.019+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:18.913 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:18.907+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:19.045 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:19.039+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:19.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:19.903+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:20.012 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:20.007+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:20.934 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:20.931+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:21.026 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:21.023+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:21.952 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:21.947+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:22.063 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:22.059+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:22.912 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:22.906+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:23.040 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:23.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:23.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:23.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:24.042 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:24.034+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:24.849 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:24.842+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:25.027 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:25.022+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:25.740 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:38:25.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:25.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:26.036 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:38:26.037 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:26.030+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:26.039 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:38:26.049 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6242,"stamp":"2024-09-16T14:38:24.863727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003268"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11032,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:20.801499+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:34:20.801499+0000","last_peered":"2024-09-16T14:34:20.801499+0000","last_clean":"2024-09-16T14:34:20.801499+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:34:20.801499+0000","last_undegraded":"2024-09-16T14:34:20.801499+0000","last_fullsized":"2024-09-16T14:34:20.801499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 655s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10718,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.103600+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:34:21.103600+0000","last_peered":"2024-09-16T14:34:21.103600+0000","last_clean":"2024-09-16T14:34:21.103600+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:34:21.103600+0000","last_undegraded":"2024-09-16T14:34:21.103600+0000","last_fullsized":"2024-09-16T14:34:21.103600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12547,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:34:21.406725+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:34:21.406725+0000","last_peered":"2024-09-16T14:34:21.406725+0000","last_clean":"2024-09-16T14:34:21.406725+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:34:21.406725+0000","last_undegraded":"2024-09-16T14:34:21.406725+0000","last_fullsized":"2024-09-16T14:34:21.406725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 634s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740803,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:37:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.68300000000000005,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.746},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740807,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.60999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.44900000000000001},"max":{"1min":0.74399999999999999,"5min":0.75,"15min":0.78900000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.70699999999999996,"5min":0.80600000000000005,"15min":0.81799999999999995},"last":0.66300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740809,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.54500000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.753,"5min":0.80400000000000005,"15min":1.02},"last":0.65100000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":1.022},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.76400000000000001},"last":0.68899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:38:26.050 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:26.051 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:26.051 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:26.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2024-09-16T14:38:26.350 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2024-09-16T14:38:26.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2024-09-16T14:38:26.653 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2024-09-16T14:38:26.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2024-09-16T14:38:26.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:26.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:26.954 INFO:teuthology.orchestra.run.smithi137.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2024-09-16T14:38:26.963 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:38:26.989 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:26.982+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:27.886 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:27.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:28.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:27.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:28.885 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:28.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:28.964 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:28.958+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:29.872 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:29.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:29.926 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:29.922+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:30.910 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:30.906+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:30.914 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:30.910+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:31.944 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:31.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:31.956 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:31.950+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:32.946 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:32.942+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:33.000 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:32.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:33.985 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:33.978+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:34.002 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:33.994+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:34.953 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:34.946+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:35.048 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:35.042+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:35.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:35.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:36.098 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:36.094+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:36.928 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:36.922+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:37.112 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:37.106+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:37.955 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:37.950+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:38.163 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:38.158+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:38.907 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:38.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:39.210 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:39.206+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:39.935 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:39.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:40.245 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:40.238+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:40.897 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:40.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:41.238 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:41.234+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:41.884 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:41.878+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:42.268 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:42.262+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:42.893 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:42.886+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:43.311 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:43.306+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:43.867 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:43.862+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:44.329 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:44.322+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:44.828 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:44.822+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:45.373 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:45.366+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:45.797 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:45.790+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:46.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:46.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:46.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:46.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:46.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:38:47.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T14:38:47.278+0000 7f7e1b7fe700 0 --2- 172.21.15.137:0/3285290581 >> v2:172.21.15.137:3300/0 conn(0x7f7e241266d0 0x7f7e24125c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-16T14:38:47.462 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:47.458+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:47.468 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:38:47.472 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:38:47.481 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6253,"stamp":"2024-09-16T14:38:46.869732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003390"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11033,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.577989+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:36:23.577989+0000","last_peered":"2024-09-16T14:36:23.577989+0000","last_clean":"2024-09-16T14:36:23.577989+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:36:23.577989+0000","last_undegraded":"2024-09-16T14:36:23.577989+0000","last_fullsized":"2024-09-16T14:36:23.577989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10719,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.866294+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:36:23.866294+0000","last_peered":"2024-09-16T14:36:23.866294+0000","last_clean":"2024-09-16T14:36:23.866294+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:36:23.866294+0000","last_undegraded":"2024-09-16T14:36:23.866294+0000","last_fullsized":"2024-09-16T14:36:23.866294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 772s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12548,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:24.165197+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:36:24.165197+0000","last_peered":"2024-09-16T14:36:24.165197+0000","last_clean":"2024-09-16T14:36:24.165197+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:36:24.165197+0000","last_undegraded":"2024-09-16T14:36:24.165197+0000","last_fullsized":"2024-09-16T14:36:24.165197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740807,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.436,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.746},"last":0.63}]},{"osd":1,"last update":"Mon Sep 16 14:37:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.746,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.628},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.79600000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740811,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.60999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.59999999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.44900000000000001},"max":{"1min":0.74399999999999999,"5min":0.75,"15min":0.78900000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.70699999999999996,"5min":0.80600000000000005,"15min":0.81799999999999995},"last":0.626}]}]},{"osd":0,"up_from":8,"seq":34359740813,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.81699999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.54500000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.753,"5min":0.80400000000000005,"15min":1.02},"last":0.65800000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.90900000000000003,"5min":0.92700000000000005,"15min":1.022},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.76400000000000001},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:38:47.482 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:47.483 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:47.483 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:38:47.483 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:38:47.873 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:47.866+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:48.469 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:48.462+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:48.890 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:48.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:49.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:49.422+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:49.857 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:49.850+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:50.428 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:50.422+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:50.879 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:50.874+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:51.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:51.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:51.862 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:51.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:52.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:52.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:52.832 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:52.826+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:53.458 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:53.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:53.863 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:53.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:54.419 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:54.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:54.889 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:54.882+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:55.441 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:55.434+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:55.865 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:55.858+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:56.421 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:56.414+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:56.909 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:56.902+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:57.459 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:57.454+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:57.943 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:57.938+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:58.478 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:58.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:58.898 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:58.890+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:59.477 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:38:59.470+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:38:59.937 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:38:59.930+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:00.471 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:00.466+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:00.980 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:00.974+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:01.442 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:01.438+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:01.998 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:01.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:02.487 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:02.482+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:02.993 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:02.986+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:03.483 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:03.478+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:04.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:04.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:04.509 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:04.502+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:05.079 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:05.074+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:05.513 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:05.506+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:06.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:06.066+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:06.493 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:06.486+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:07.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:07.018+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:07.484 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:39:07.503 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:07.498+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:07.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:39:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:39:07.787 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6263,"stamp":"2024-09-16T14:39:06.875245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003379"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11033,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.577989+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:36:23.577989+0000","last_peered":"2024-09-16T14:36:23.577989+0000","last_clean":"2024-09-16T14:36:23.577989+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:36:23.577989+0000","last_undegraded":"2024-09-16T14:36:23.577989+0000","last_fullsized":"2024-09-16T14:36:23.577989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10719,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.866294+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:36:23.866294+0000","last_peered":"2024-09-16T14:36:23.866294+0000","last_clean":"2024-09-16T14:36:23.866294+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:36:23.866294+0000","last_undegraded":"2024-09-16T14:36:23.866294+0000","last_fullsized":"2024-09-16T14:36:23.866294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 772s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12548,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:24.165197+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:36:24.165197+0000","last_peered":"2024-09-16T14:36:24.165197+0000","last_clean":"2024-09-16T14:36:24.165197+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:36:24.165197+0000","last_undegraded":"2024-09-16T14:36:24.165197+0000","last_fullsized":"2024-09-16T14:36:24.165197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740811,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.436,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.746},"last":0.50900000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.70299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.621,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54700000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740815,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.42899999999999999,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.60999999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77900000000000003,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.59799999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:38:18 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.58299999999999996},"min":{"1min":0.54000000000000004,"5min":0.47999999999999998,"15min":0.44900000000000001},"max":{"1min":0.74399999999999999,"5min":0.75,"15min":0.78900000000000003},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.70699999999999996,"5min":0.80600000000000005,"15min":0.81799999999999995},"last":0.69299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740817,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81699999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":1.02},"last":0.69499999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.92700000000000005,"15min":1.022},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76400000000000001},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:39:07.789 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:07.789 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:07.789 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:07.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:39:08.007 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:08.002+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:08.482 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:08.474+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:08.975 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:08.970+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:09.524 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:09.518+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:10.014 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:10.010+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:10.574 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:10.566+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:11.046 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:11.038+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:11.578 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:11.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:12.021 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:12.014+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:12.579 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:12.574+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:13.040 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:13.034+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:13.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:13.554+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:14.002 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:13.994+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:14.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:14.586+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:15.028 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:15.022+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:15.632 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:15.626+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:16.027 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:16.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:16.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:16.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:17.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:17.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:17.671 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:17.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:18.096 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:18.089+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:18.707 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:18.701+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:19.065 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:19.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:19.662 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:19.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:20.037 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:20.029+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:20.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:20.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:21.013 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:21.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:21.665 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:21.657+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:21.979 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:21.973+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:22.635 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:22.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:22.970 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:22.965+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:23.627 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:23.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:24.000 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:23.993+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:24.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:24.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:25.026 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:25.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:25.638 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:25.629+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:25.984 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:25.977+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:26.622 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:26.617+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:26.969 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:26.961+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:27.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:27.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:27.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:39:28.008 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:28.001+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:28.096 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:39:28.098 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:39:28.109 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6273,"stamp":"2024-09-16T14:39:26.880819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003381"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11033,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.577989+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:36:23.577989+0000","last_peered":"2024-09-16T14:36:23.577989+0000","last_clean":"2024-09-16T14:36:23.577989+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:36:23.577989+0000","last_undegraded":"2024-09-16T14:36:23.577989+0000","last_fullsized":"2024-09-16T14:36:23.577989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10719,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.866294+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:36:23.866294+0000","last_peered":"2024-09-16T14:36:23.866294+0000","last_clean":"2024-09-16T14:36:23.866294+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:36:23.866294+0000","last_undegraded":"2024-09-16T14:36:23.866294+0000","last_fullsized":"2024-09-16T14:36:23.866294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 772s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12548,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:24.165197+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:36:24.165197+0000","last_peered":"2024-09-16T14:36:24.165197+0000","last_clean":"2024-09-16T14:36:24.165197+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:36:24.165197+0000","last_undegraded":"2024-09-16T14:36:24.165197+0000","last_fullsized":"2024-09-16T14:36:24.165197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740815,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:38:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.436,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53400000000000003,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.746},"last":0.66800000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.70299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.621,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740819,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65000000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.53300000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.78900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.81799999999999995},"last":0.56999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740821,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81699999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":1.02},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.92700000000000005,"15min":1.022},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76400000000000001},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:39:28.110 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:28.111 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:28.111 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:28.111 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:39:28.670 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:28.661+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:29.054 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:29.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:29.698 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:29.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:30.103 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:30.097+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:30.687 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:30.681+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:31.122 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:31.117+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:31.677 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:31.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:32.098 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:32.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:32.650 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:32.645+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:33.142 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:33.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:33.655 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:33.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:34.100 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:34.093+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:34.639 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:34.633+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:35.059 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:35.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:35.675 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:35.669+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:36.023 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:36.017+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:36.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:36.673+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:37.038 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:37.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:37.693 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:37.685+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:38.087 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:38.081+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:38.657 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:38.649+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:39.041 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:39.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:39.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:39.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:40.091 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:40.085+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:40.609 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:40.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:41.115 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:41.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:41.593 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:41.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:42.163 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:42.157+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:42.614 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:42.605+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:43.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:43.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:43.581 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:43.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:44.130 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:44.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:44.592 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:44.585+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:45.128 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:45.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:45.586 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:45.577+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:46.129 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:46.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:46.596 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:46.589+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:47.117 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:47.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:47.554 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:47.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:48.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:39:48.114 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:48.109+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:48.408 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:39:48.411 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:39:48.421 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6283,"stamp":"2024-09-16T14:39:46.886231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003144"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11033,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.577989+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:36:23.577989+0000","last_peered":"2024-09-16T14:36:23.577989+0000","last_clean":"2024-09-16T14:36:23.577989+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:36:23.577989+0000","last_undegraded":"2024-09-16T14:36:23.577989+0000","last_fullsized":"2024-09-16T14:36:23.577989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10719,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.866294+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:36:23.866294+0000","last_peered":"2024-09-16T14:36:23.866294+0000","last_clean":"2024-09-16T14:36:23.866294+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:36:23.866294+0000","last_undegraded":"2024-09-16T14:36:23.866294+0000","last_fullsized":"2024-09-16T14:36:23.866294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 772s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12548,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:24.165197+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:36:24.165197+0000","last_peered":"2024-09-16T14:36:24.165197+0000","last_clean":"2024-09-16T14:36:24.165197+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:36:24.165197+0000","last_undegraded":"2024-09-16T14:36:24.165197+0000","last_fullsized":"2024-09-16T14:36:24.165197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.76500000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Sep 16 14:39:00 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.48599999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.70299999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.621,"15min":0.628},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56200000000000006}]}]},{"osd":1,"up_from":8,"seq":34359740823,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65000000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.61299999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.78900000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.81799999999999995},"last":0.55200000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740825,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81699999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":1.02},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.92700000000000005,"15min":1.022},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76400000000000001},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:39:48.422 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:48.423 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:48.423 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:39:48.423 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:39:48.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:48.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:49.071 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:49.065+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:49.533 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:49.525+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:50.060 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:50.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:50.575 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:50.569+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:51.064 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:51.057+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:51.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:51.545+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:52.113 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:52.105+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:52.562 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:52.557+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:53.131 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:53.125+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:53.570 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:53.565+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:54.145 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:54.137+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:54.568 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:54.561+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:55.126 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:55.121+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:55.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:55.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:56.078 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:56.073+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:56.559 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:56.553+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:57.031 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:57.025+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:57.521 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:57.513+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:58.073 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:58.069+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:58.553 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:58.549+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:59.036 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:39:59.033+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:39:59.580 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:39:59.573+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:00.029 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:00.021+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:00.625 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:00.621+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:01.052 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:01.049+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:01.605 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:01.601+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:02.055 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:02.053+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:02.628 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:02.625+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:03.010 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:03.005+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:03.678 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:03.677+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:03.990 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:03.989+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:04.668 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:04.665+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:04.999 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:04.997+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:05.656 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:05.653+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:06.015 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:06.013+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:06.695 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:06.693+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:07.049 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:07.045+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:07.735 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:07.733+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:08.045 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-09-16T14:40:08.041+0000 7fd339f70700 -1 osd.1 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:673 3.2 3:4140f5ef:::rbd_data.297afc23426c.0000000000000042:head [set-alloc-hint object_size 4194304 write_size 4194304,write 40960~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:08.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:40:08.712 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T14:40:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T14:40:08.725 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":6293,"stamp":"2024-09-16T14:40:06.891915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1514625983,"num_objects":603,"num_object_clones":1,"num_object_copies":1206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":141,"num_read":68864,"num_read_kb":613553,"num_write":27367,"num_write_kb":8916288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1939,"num_omap_keys":184,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35488,"ondisk_log_size":35488,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1525816,"kb_used_data":608800,"kb_used_omap":4,"kb_used_meta":916987,"kb_avail":281589704,"statfs":{"total":289910292480,"available":288347856896,"internally_reserved":0,"allocated":623411200,"data_stored":621022482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5112,"internal_metadata":938994696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003529"},"pg_stats":[{"pgid":"2.7","version":"167'1953","reported_seq":3015,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:38.625635+0000","last_change":"2024-09-16T14:25:38.625549+0000","last_active":"2024-09-16T14:25:38.625635+0000","last_peered":"2024-09-16T14:25:38.625635+0000","last_clean":"2024-09-16T14:25:38.625635+0000","last_became_active":"2024-09-16T11:15:53.948776+0000","last_became_peered":"2024-09-16T11:15:53.948776+0000","last_unstale":"2024-09-16T14:25:38.625635+0000","last_undegraded":"2024-09-16T14:25:38.625635+0000","last_fullsized":"2024-09-16T14:25:38.625635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1953","last_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_deep_scrub":"167'1953","last_deep_scrub_stamp":"2024-09-16T14:25:38.625383+0000","last_clean_scrub_stamp":"2024-09-16T14:25:38.625383+0000","objects_scrubbed":51,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:14:06.893862+0000","scrub_duration":0.28611114700000001,"objects_trimmed":0,"snaptrim_duration":0.0012743190000000001,"stat_sum":{"num_bytes":178958491,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":790,"num_read_kb":33839,"num_write":1756,"num_write_kb":1161781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'1741","reported_seq":2738,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:42.622156+0000","last_change":"2024-09-16T14:25:42.622088+0000","last_active":"2024-09-16T14:25:42.622156+0000","last_peered":"2024-09-16T14:25:42.622156+0000","last_clean":"2024-09-16T14:25:42.622156+0000","last_became_active":"2024-09-16T11:15:53.948239+0000","last_became_peered":"2024-09-16T11:15:53.948239+0000","last_unstale":"2024-09-16T14:25:42.622156+0000","last_undegraded":"2024-09-16T14:25:42.622156+0000","last_fullsized":"2024-09-16T14:25:42.622156+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1741","last_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_deep_scrub":"167'1741","last_deep_scrub_stamp":"2024-09-16T14:25:42.621908+0000","last_clean_scrub_stamp":"2024-09-16T14:25:42.621908+0000","objects_scrubbed":41,"log_size":1741,"log_dups_size":0,"ondisk_log_size":1741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:31.780616+0000","scrub_duration":0.241951691,"objects_trimmed":0,"snaptrim_duration":0.001187462,"stat_sum":{"num_bytes":157704208,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":657,"num_read_kb":18410,"num_write":1568,"num_write_kb":1165473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'2088","reported_seq":3148,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:45.491861+0000","last_change":"2024-09-16T14:25:45.491817+0000","last_active":"2024-09-16T14:25:45.491861+0000","last_peered":"2024-09-16T14:25:45.491861+0000","last_clean":"2024-09-16T14:25:45.491861+0000","last_became_active":"2024-09-16T11:15:53.949122+0000","last_became_peered":"2024-09-16T11:15:53.949122+0000","last_unstale":"2024-09-16T14:25:45.491861+0000","last_undegraded":"2024-09-16T14:25:45.491861+0000","last_fullsized":"2024-09-16T14:25:45.491861+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2088","last_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_deep_scrub":"167'2088","last_deep_scrub_stamp":"2024-09-16T14:25:45.491693+0000","last_clean_scrub_stamp":"2024-09-16T14:25:45.491693+0000","objects_scrubbed":46,"log_size":2088,"log_dups_size":0,"ondisk_log_size":2088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:01:46.302883+0000","scrub_duration":0.22141142899999999,"objects_trimmed":0,"snaptrim_duration":0.00099057300000000002,"stat_sum":{"num_bytes":147857689,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":805,"num_read_kb":12889,"num_write":1881,"num_write_kb":1097821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":616,"num_omap_keys":45,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'2159","reported_seq":3191,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:43.635810+0000","last_change":"2024-09-16T14:25:43.635751+0000","last_active":"2024-09-16T14:25:43.635810+0000","last_peered":"2024-09-16T14:25:43.635810+0000","last_clean":"2024-09-16T14:25:43.635810+0000","last_became_active":"2024-09-16T11:15:53.949629+0000","last_became_peered":"2024-09-16T11:15:53.949629+0000","last_unstale":"2024-09-16T14:25:43.635810+0000","last_undegraded":"2024-09-16T14:25:43.635810+0000","last_fullsized":"2024-09-16T14:25:43.635810+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2159","last_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_deep_scrub":"167'2159","last_deep_scrub_stamp":"2024-09-16T14:25:43.635610+0000","last_clean_scrub_stamp":"2024-09-16T14:25:43.635610+0000","objects_scrubbed":59,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:36:43.111488+0000","scrub_duration":0.29503680199999999,"objects_trimmed":0,"snaptrim_duration":0.0011965540000000001,"stat_sum":{"num_bytes":199000215,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":684,"num_read_kb":8325,"num_write":1941,"num_write_kb":1084457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":26,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"163'4394","reported_seq":11033,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.577989+0000","last_change":"2024-09-16T14:25:27.943722+0000","last_active":"2024-09-16T14:36:23.577989+0000","last_peered":"2024-09-16T14:36:23.577989+0000","last_clean":"2024-09-16T14:36:23.577989+0000","last_became_active":"2024-09-16T11:16:02.015665+0000","last_became_peered":"2024-09-16T11:16:02.015665+0000","last_unstale":"2024-09-16T14:36:23.577989+0000","last_undegraded":"2024-09-16T14:36:23.577989+0000","last_fullsized":"2024-09-16T14:36:23.577989+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4394,"log_dups_size":0,"ondisk_log_size":4394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00106828,"stat_sum":{"num_bytes":52815575,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":33,"num_read":12164,"num_read_kb":171671,"num_write":3073,"num_write_kb":2612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1751,"num_flush":213,"num_flush_kb":43712,"num_evict":538,"num_evict_kb":127309,"num_promote":586,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"167'1748","reported_seq":2833,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:31.192598+0000","last_change":"2024-09-16T14:25:31.192568+0000","last_active":"2024-09-16T14:25:31.192598+0000","last_peered":"2024-09-16T14:25:31.192598+0000","last_clean":"2024-09-16T14:25:31.192598+0000","last_became_active":"2024-09-16T11:15:53.950750+0000","last_became_peered":"2024-09-16T11:15:53.950750+0000","last_unstale":"2024-09-16T14:25:31.192598+0000","last_undegraded":"2024-09-16T14:25:31.192598+0000","last_fullsized":"2024-09-16T14:25:31.192598+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1748","last_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_deep_scrub":"167'1748","last_deep_scrub_stamp":"2024-09-16T14:25:31.192446+0000","last_clean_scrub_stamp":"2024-09-16T14:25:31.192446+0000","objects_scrubbed":53,"log_size":1748,"log_dups_size":0,"ondisk_log_size":1748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:46:46.723180+0000","scrub_duration":0.25011782599999999,"objects_trimmed":0,"snaptrim_duration":0.00077729999999999997,"stat_sum":{"num_bytes":160858351,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":729,"num_read_kb":10490,"num_write":1552,"num_write_kb":1104371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":18,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"167'5358","reported_seq":11809,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:47.451235+0000","last_change":"2024-09-16T14:25:47.451176+0000","last_active":"2024-09-16T14:25:47.451235+0000","last_peered":"2024-09-16T14:25:47.451235+0000","last_clean":"2024-09-16T14:25:47.451235+0000","last_became_active":"2024-09-16T11:16:02.013152+0000","last_became_peered":"2024-09-16T11:16:02.013152+0000","last_unstale":"2024-09-16T14:25:47.451235+0000","last_undegraded":"2024-09-16T14:25:47.451235+0000","last_fullsized":"2024-09-16T14:25:47.451235+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'5358","last_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_deep_scrub":"167'5358","last_deep_scrub_stamp":"2024-09-16T14:25:47.450989+0000","last_clean_scrub_stamp":"2024-09-16T14:25:47.450989+0000","objects_scrubbed":53,"log_size":5358,"log_dups_size":0,"ondisk_log_size":5358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:59.986630+0000","scrub_duration":0.244043391,"objects_trimmed":0,"snaptrim_duration":0.00085770200000000001,"stat_sum":{"num_bytes":49325095,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":36,"num_read":12684,"num_read_kb":100201,"num_write":3052,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1063,"num_flush":222,"num_flush_kb":5206,"num_evict":582,"num_evict_kb":55906,"num_promote":632,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"167'1625","reported_seq":2662,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:04.520205+0000","last_change":"2024-09-16T14:23:04.520150+0000","last_active":"2024-09-16T14:23:04.520205+0000","last_peered":"2024-09-16T14:23:04.520205+0000","last_clean":"2024-09-16T14:23:04.520205+0000","last_became_active":"2024-09-16T11:15:53.948013+0000","last_became_peered":"2024-09-16T11:15:53.948013+0000","last_unstale":"2024-09-16T14:23:04.520205+0000","last_undegraded":"2024-09-16T14:23:04.520205+0000","last_fullsized":"2024-09-16T14:23:04.520205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'1625","last_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_deep_scrub":"167'1625","last_deep_scrub_stamp":"2024-09-16T14:23:04.520036+0000","last_clean_scrub_stamp":"2024-09-16T14:23:04.520036+0000","objects_scrubbed":45,"log_size":1625,"log_dups_size":0,"ondisk_log_size":1625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:56:20.421513+0000","scrub_duration":0.24486987700000001,"objects_trimmed":0,"snaptrim_duration":0.00068798600000000002,"stat_sum":{"num_bytes":149213572,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":758,"num_read_kb":6044,"num_write":1465,"num_write_kb":1057363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":296,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'5157","reported_seq":10719,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:23.866294+0000","last_change":"2024-09-16T14:25:33.933600+0000","last_active":"2024-09-16T14:36:23.866294+0000","last_peered":"2024-09-16T14:36:23.866294+0000","last_clean":"2024-09-16T14:36:23.866294+0000","last_became_active":"2024-09-16T11:16:02.015976+0000","last_became_peered":"2024-09-16T11:16:02.015976+0000","last_unstale":"2024-09-16T14:36:23.866294+0000","last_undegraded":"2024-09-16T14:36:23.866294+0000","last_fullsized":"2024-09-16T14:36:23.866294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":24,"log_size":5157,"log_dups_size":0,"ondisk_log_size":5157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 772s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058434100000000005,"stat_sum":{"num_bytes":24184028,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":21427,"num_read_kb":73359,"num_write":5199,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1048,"num_flush":196,"num_flush_kb":26,"num_evict":622,"num_evict_kb":26548,"num_promote":673,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"167'2217","reported_seq":3282,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:23:07.544974+0000","last_change":"2024-09-16T14:23:07.544921+0000","last_active":"2024-09-16T14:23:07.544974+0000","last_peered":"2024-09-16T14:23:07.544974+0000","last_clean":"2024-09-16T14:23:07.544974+0000","last_became_active":"2024-09-16T11:15:53.945747+0000","last_became_peered":"2024-09-16T11:15:53.945747+0000","last_unstale":"2024-09-16T14:23:07.544974+0000","last_undegraded":"2024-09-16T14:23:07.544974+0000","last_fullsized":"2024-09-16T14:23:07.544974+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2217","last_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_deep_scrub":"167'2217","last_deep_scrub_stamp":"2024-09-16T14:23:07.544741+0000","last_clean_scrub_stamp":"2024-09-16T14:23:07.544741+0000","objects_scrubbed":45,"log_size":2217,"log_dups_size":0,"ondisk_log_size":2217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:49:44.766428+0000","scrub_duration":0.24046367699999999,"objects_trimmed":0,"snaptrim_duration":0.000566834,"stat_sum":{"num_bytes":148713538,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":882,"num_read_kb":13053,"num_write":1596,"num_write_kb":1136467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149,"num_omap_keys":17,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"163'4539","reported_seq":12548,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T14:36:24.165197+0000","last_change":"2024-09-16T14:25:49.255814+0000","last_active":"2024-09-16T14:36:24.165197+0000","last_peered":"2024-09-16T14:36:24.165197+0000","last_clean":"2024-09-16T14:36:24.165197+0000","last_became_active":"2024-09-16T11:16:02.012904+0000","last_became_peered":"2024-09-16T11:16:02.012904+0000","last_unstale":"2024-09-16T14:36:24.165197+0000","last_undegraded":"2024-09-16T14:36:24.165197+0000","last_fullsized":"2024-09-16T14:36:24.165197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T11:16:00.961023+0000","last_clean_scrub_stamp":"2024-09-16T11:16:00.961023+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041696650000000004,"stat_sum":{"num_bytes":65901664,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":29,"num_read":16569,"num_read_kb":140794,"num_write":2401,"num_write_kb":2050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":1104,"num_flush":209,"num_flush_kb":32260,"num_evict":641,"num_evict_kb":79260,"num_promote":689,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"167'2455","reported_seq":3489,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:29.616225+0000","last_change":"2024-09-16T14:25:29.616177+0000","last_active":"2024-09-16T14:25:29.616225+0000","last_peered":"2024-09-16T14:25:29.616225+0000","last_clean":"2024-09-16T14:25:29.616225+0000","last_became_active":"2024-09-16T11:15:53.947792+0000","last_became_peered":"2024-09-16T11:15:53.947792+0000","last_unstale":"2024-09-16T14:25:29.616225+0000","last_undegraded":"2024-09-16T14:25:29.616225+0000","last_fullsized":"2024-09-16T14:25:29.616225+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'2455","last_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_deep_scrub":"167'2455","last_deep_scrub_stamp":"2024-09-16T14:25:29.616029+0000","last_clean_scrub_stamp":"2024-09-16T14:25:29.616029+0000","objects_scrubbed":53,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:35:23.674833+0000","scrub_duration":0.25513850900000001,"objects_trimmed":0,"snaptrim_duration":0.00069246200000000003,"stat_sum":{"num_bytes":179503189,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":659,"num_read_kb":24432,"num_write":1804,"num_write_kb":1096534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":249,"num_omap_keys":27,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"167'54","reported_seq":242,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-16T14:25:35.397888+0000","last_change":"2024-09-16T14:25:35.397851+0000","last_active":"2024-09-16T14:25:35.397888+0000","last_peered":"2024-09-16T14:25:35.397888+0000","last_clean":"2024-09-16T14:25:35.397888+0000","last_became_active":"2024-09-16T11:15:50.649862+0000","last_became_peered":"2024-09-16T11:15:50.649862+0000","last_unstale":"2024-09-16T14:25:35.397888+0000","last_undegraded":"2024-09-16T14:25:35.397888+0000","last_fullsized":"2024-09-16T14:25:35.397888+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"167'54","last_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_deep_scrub":"167'54","last_deep_scrub_stamp":"2024-09-16T14:25:35.397720+0000","last_clean_scrub_stamp":"2024-09-16T14:25:35.397720+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:46.592989+0000","scrub_duration":0.01023659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":192226362,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":140,"num_read":62844,"num_read_kb":486025,"num_write":13725,"num_write_kb":10915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":4966,"num_flush":840,"num_flush_kb":81204,"num_evict":2383,"num_evict_kb":289023,"num_promote":2580,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":325885952,"data_stored":325757044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19448,"ondisk_log_size":19448,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1321809253,"num_objects":393,"num_object_clones":1,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":1,"num_read":5964,"num_read_kb":127482,"num_write":13563,"num_write_kb":8904267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1865,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":292151296,"data_stored":291941066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15986,"ondisk_log_size":15986,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740823,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":533344,"kb_used_data":223512,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93838496,"statfs":{"total":96636764160,"available":96090619904,"internally_reserved":0,"allocated":228876288,"data_stored":228105860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.28199999999999997},"max":{"1min":0.68799999999999994,"5min":0.70899999999999996,"15min":0.76500000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.5,"5min":0.46000000000000002,"15min":0.315},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.746},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:40:01 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60099999999999998,"15min":0.59399999999999997},"min":{"1min":0.49099999999999999,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":0.77400000000000002,"15min":0.95999999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.53900000000000003,"5min":0.41899999999999998,"15min":0.35399999999999998},"max":{"1min":0.68500000000000005,"5min":0.79600000000000004,"15min":0.93000000000000005},"last":0.65100000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740827,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":549140,"kb_used_data":239308,"kb_used_omap":1,"kb_used_meta":309822,"kb_avail":93822700,"statfs":{"total":96636764160,"available":96074444800,"internally_reserved":0,"allocated":245051392,"data_stored":244234299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":317258072},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65000000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.623},"min":{"1min":0.38500000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71399999999999997,"5min":0.86399999999999999,"15min":0.97899999999999998},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:39:20 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61399999999999999,"15min":0.58899999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.44900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.78900000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69299999999999995,"5min":0.78900000000000003,"15min":0.81799999999999995},"last":0.55600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740829,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443332,"kb_used_data":145980,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93928508,"statfs":{"total":96636764160,"available":96182792192,"internally_reserved":0,"allocated":149483520,"data_stored":148682323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.40600000000000003,"5min":0.33000000000000002,"15min":0.251},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81699999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.54600000000000004,"5min":0.45100000000000001,"15min":0.34100000000000003},"max":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":1.02},"last":0.60599999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:39:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.748,"5min":0.92700000000000005,"15min":1.022},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76400000000000001},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81539072,"data_stored":81457994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":146075648,"data_stored":145970533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64536576,"data_stored":64512539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65957888,"data_stored":65919923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":96985088,"data_stored":96958599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":162942976,"data_stored":162878522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:40:08.727 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:40:08.727 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:40:08.727 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T11:16:00.961023+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=11, tm_min=16, tm_sec=0, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=19, tm_sec=2, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:40:08.727 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1905, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1300, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2024-09-16T14:40:08.737 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T14:40:08.737 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T14:40:08.737 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T14:40:08.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:40:08.743 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-09-16T14:40:08.725+0000 7fd03e9ab700 -1 osd.0 167 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10621.0:384 3.1 3:a3f9b32f:::rbd_data.297afc23426c.0000000000000052:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2387968~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e163) 2024-09-16T14:40:08.823 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T14:40:08.823 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T14:40:08.823 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:40:08.913 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T14:40:08.914 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T14:40:08.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:40:08.992 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T14:40:08.992 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T14:40:08.993 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T14:40:08.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:40:09.020 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T14:40:09.020 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T14:40:09.020 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T14:40:09.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:40:09.043 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T14:40:09.044 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T14:40:09.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2024-09-16T14:40:09.061 INFO:teuthology.orchestra.run.smithi137.stdout:1726485757.3279948 osd.1 (osd.1) 3 : cluster [WRN] 1 slow requests (by type [ 'reached pg' : 1 ] most affected pool [ 'cache' : 1 ]) 2024-09-16T14:40:09.064 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-16T14:40:09.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T14:40:09.064 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T14:40:09.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T14:40:09.423 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T14:40:09.722 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T14:40:09.722 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T14:40:09.881 INFO:tasks.ceph:Archiving mon data... 2024-09-16T14:40:09.883 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165/data/mon.a.tgz 2024-09-16T14:40:09.883 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-16T14:40:09.887 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.OPTMxfrVgj 2024-09-16T14:40:09.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.OPTMxfrVgj 2024-09-16T14:40:10.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.OPTMxfrVgj 2024-09-16T14:40:10.051 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.OPTMxfrVgj is 444KB 2024-09-16T14:40:10.112 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.OPTMxfrVgj 2024-09-16T14:40:10.119 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T14:40:10.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T14:40:10.136 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-16T14:40:10.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T14:40:10.156 INFO:teuthology.orchestra.run.smithi137.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T14:40:10.162 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T14:40:10.164 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165/remote/smithi137/crash 2024-09-16T14:40:10.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T14:40:10.220 INFO:tasks.ceph:Compressing logs... 2024-09-16T14:40:10.220 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T14:40:10.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51840.log 2024-09-16T14:40:10.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30088.log 2024-09-16T14:40:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64842.log 2024-09-16T14:40:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51840.log.gz 2024-09-16T14:40:10.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51373.log 2024-09-16T14:40:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30088.log: /var/log/ceph/ceph-client.admin.64842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30088.log.gz 2024-09-16T14:40:10.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52681.log 2024-09-16T14:40:10.239 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64842.log.gz 2024-09-16T14:40:10.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51373.log.gz 2024-09-16T14:40:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62153.log 2024-09-16T14:40:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52681.log.gz 2024-09-16T14:40:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-09-16T14:40:10.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60743.log 2024-09-16T14:40:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62153.log: /var/log/ceph/ceph-client.admin.35749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62153.log.gz 0.0% 2024-09-16T14:40:10.241 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-09-16T14:40:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67762.log 2024-09-16T14:40:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60743.log.gz 2024-09-16T14:40:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25846.log 2024-09-16T14:40:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67762.log.gz 2024-09-16T14:40:10.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2024-09-16T14:40:10.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71598.log 2024-09-16T14:40:10.244 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25846.log.gz 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53937.log 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60592.log 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71598.log.gz 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-09-16T14:40:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53937.log.gz 2024-09-16T14:40:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60592.log.gz 2024-09-16T14:40:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70976.log 2024-09-16T14:40:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2024-09-16T14:40:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-09-16T14:40:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2024-09-16T14:40:10.248 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70976.log.gz 2024-09-16T14:40:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2024-09-16T14:40:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2024-09-16T14:40:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2024-09-16T14:40:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53380.log 2024-09-16T14:40:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2024-09-16T14:40:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53380.log.gz 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66767.log 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61541.log 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33142.log: /var/log/ceph/ceph-client.admin.66767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66767.log.gz 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2024-09-16T14:40:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2024-09-16T14:40:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-09-16T14:40:10.252 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61541.log.gz 2024-09-16T14:40:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2024-09-16T14:40:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69233.log 2024-09-16T14:40:10.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38607.log 2024-09-16T14:40:10.254 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-09-16T14:40:10.254 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log 2024-09-16T14:40:10.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69233.log: /var/log/ceph/ceph-client.admin.38607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69233.log.gz 2024-09-16T14:40:10.255 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38607.log.gz 2024-09-16T14:40:10.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36820.log 2024-09-16T14:40:10.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39174.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39174.log.gz 2024-09-16T14:40:10.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33006.log 2024-09-16T14:40:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56278.log 2024-09-16T14:40:10.258 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36820.log.gz 2024-09-16T14:40:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33006.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33006.log.gz 2024-09-16T14:40:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28962.log 2024-09-16T14:40:10.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67500.log 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56278.log.gz 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28962.log.gz 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67500.log: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.67500.log.gz 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54841.log 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gz 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27202.log 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54841.log.gz 2024-09-16T14:40:10.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60361.log 2024-09-16T14:40:10.260 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27202.log.gz 2024-09-16T14:40:10.260 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27777.log 2024-09-16T14:40:10.264 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60361.log.gz 2024-09-16T14:40:10.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58325.log 2024-09-16T14:40:10.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65275.log 2024-09-16T14:40:10.264 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27777.log: /var/log/ceph/ceph-client.admin.58325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27777.log.gz 2024-09-16T14:40:10.264 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58325.log.gz 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69104.log 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65275.log.gz 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60785.log 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69104.log.gz 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69083.log 2024-09-16T14:40:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60785.log.gz 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39745.log 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69083.log.gz 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27607.log 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39745.log.gz 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67642.log 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38417.log 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27607.log.gz 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37364.log 2024-09-16T14:40:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67642.log: /var/log/ceph/ceph-client.admin.38417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67642.log.gz 2024-09-16T14:40:10.267 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2024-09-16T14:40:10.267 INFO:teuthology.orchestra.run.smithi137.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.38417.log.gz 2024-09-16T14:40:10.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37364.log.gz 2024-09-16T14:40:10.277 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62449.log 2024-09-16T14:40:10.277 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-09-16T14:40:10.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56342.log: /var/log/ceph/ceph-client.admin.62449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62449.log.gz 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59252.log 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63743.log 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59252.log.gz 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55835.log 2024-09-16T14:40:10.278 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63743.log.gz 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56322.log 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50729.log: /var/log/ceph/ceph-client.admin.55835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55835.log.gz 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27531.log 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64390.log 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56322.log: /var/log/ceph/ceph-client.admin.27531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27531.log.gz 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56322.log.gz 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-09-16T14:40:10.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64390.log.gz 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52397.log 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38438.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41016.log 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52397.log.gz 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27068.log 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.41016.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39638.log 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41016.log.gz 2024-09-16T14:40:10.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27068.log.gz 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67292.log 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39638.log.gz 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49344.log: /var/log/ceph/ceph-client.admin.67292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67292.log.gz 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2024-09-16T14:40:10.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69808.log 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32224.log: /var/log/ceph/ceph-client.admin.41698.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr: 17.2% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58347.log 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69808.log.gz 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27853.log 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26113.log 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58347.log.gz 2024-09-16T14:40:10.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66101.log 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30959.log 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27853.log.gz 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27374.log 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26113.log.gz 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66101.log.gz 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28921.log 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30959.log.gz 2024-09-16T14:40:10.283 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-09-16T14:40:10.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27374.log: /var/log/ceph/ceph-client.admin.28921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27374.log.gz 2024-09-16T14:40:10.284 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71517.log 2024-09-16T14:40:10.284 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28921.log.gz 2024-09-16T14:40:10.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42406.log 2024-09-16T14:40:10.284 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71517.log.gz 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51329.log 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64099.log 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70268.log 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51329.log.gz 2024-09-16T14:40:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49387.log 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64099.log: /var/log/ceph/ceph-client.admin.70268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65087.log 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64099.log.gz 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70268.log.gz 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36769.log 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49387.log.gz 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65194.log 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65087.log.gz 2024-09-16T14:40:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36769.log.gz 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30604.log 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65194.log.gz 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61484.log 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68482.log 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30604.log.gz 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63783.log 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61484.log.gz 2024-09-16T14:40:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45843.log 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68482.log: 27.9% -- replaced with /var/log/ceph/ceph-client.admin.68482.log.gz 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61013.log 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63783.log.gz 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64347.log 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45843.log.gz 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61013.log.gz 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40406.log 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38544.log 2024-09-16T14:40:10.303 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64347.log.gz 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40406.log.gz 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25557.log 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49431.log 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38544.log.gz 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.25557.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60882.log 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25557.log.gz 2024-09-16T14:40:10.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58595.log 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49431.log.gz 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60882.log.gz 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58595.log.gz 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log: /var/log/ceph/ceph-client.admin.30712.log 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30454.log.gz 2024-09-16T14:40:10.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51245.log 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30712.log.gz 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38396.log 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51245.log.gz 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50772.log 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32921.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28479.log 2024-09-16T14:40:10.306 INFO:teuthology.orchestra.run.smithi137.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.38396.log.gz 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29423.log /var/log/ceph/ceph-client.admin.50772.log: 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50772.log.gz 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54906.log 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28479.log.gz 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48915.log 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29423.log.gz 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72305.log 2024-09-16T14:40:10.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54906.log.gz 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62550.log 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48915.log.gz 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61618.log 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72305.log.gz 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26939.log 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62550.log.gz 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2024-09-16T14:40:10.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61618.log: /var/log/ceph/ceph-client.admin.26939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61618.log.gz 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54239.log 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26939.log.gz 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.32479.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72008.log 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54884.log 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54239.log.gz 2024-09-16T14:40:10.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53787.log 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72008.log.gz 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54884.log: /var/log/ceph/ceph-client.admin.53787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53787.log.gz 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51991.log 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54884.log.gz 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33669.log 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2024-09-16T14:40:10.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51991.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51991.log.gz 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33669.log.gz 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52557.log 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28286.log 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.52557.log: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T14:40:10.311 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52557.log.gz 2024-09-16T14:40:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62287.log 2024-09-16T14:40:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28286.log.gz 2024-09-16T14:40:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49496.log 2024-09-16T14:40:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62287.log.gzgzip 2024-09-16T14:40:10.312 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-16T14:40:10.350 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71734.log /var/log/ceph/ceph-client.admin.49496.log: 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49496.log.gz 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.43612.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60319.log 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57115.log 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71734.log.gz 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38712.log 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60319.log.gz 2024-09-16T14:40:10.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30771.log 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57115.log.gz 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38712.log.gz 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35919.log 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30771.log: /var/log/ceph/ceph-client.admin.46382.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.30771.log.gz 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-09-16T14:40:10.352 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64777.log 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35919.log.gz 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39681.log 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65108.log 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64777.log.gz 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26327.log 2024-09-16T14:40:10.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39681.log.gz 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64498.log 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65108.log.gz 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26327.log.gz 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32666.log 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64498.log: /var/log/ceph/ceph-client.admin.49517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49646.log 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64498.log.gz 2024-09-16T14:40:10.354 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42245.log 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32666.log.gz 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37555.log 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49646.log.gz 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57590.log 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42245.log: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.42245.log.gz 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62531.log 2024-09-16T14:40:10.355 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37555.log.gz 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27276.log 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57590.log.gz 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65649.log 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62531.log.gz 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39896.log 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27276.log.gz 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2024-09-16T14:40:10.356 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.65649.log.gz 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39896.log.gz 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35708.log 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69728.log 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35708.log.gz 2024-09-16T14:40:10.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69577.log 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69728.log.gz 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27587.log 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69577.log.gz 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40656.log 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68095.log 2024-09-16T14:40:10.358 INFO:teuthology.orchestra.run.smithi137.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27587.log.gz 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27549.log 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40656.log.gz 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68095.log.gz 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46716.log 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27549.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27549.log.gz 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59080.log 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-09-16T14:40:10.359 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62920.log 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46716.log.gz 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59080.log: /var/log/ceph/ceph-client.admin.62920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59080.log.gz 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70162.log 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62920.log.gz 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64177.log 2024-09-16T14:40:10.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64304.log 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70162.log.gz 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64177.log.gz 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71625.log 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64304.log.gz 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2024-09-16T14:40:10.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33312.log /var/log/ceph/ceph-client.admin.71625.log: 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71625.log.gz 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34026.log 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62900.log 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33312.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33312.log.gz 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58757.log 2024-09-16T14:40:10.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34026.log.gz 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43690.log 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62900.log.gz 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58757.log.gz 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.43690.log: -- /var/log/ceph/ceph-client.admin.38354.log 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43690.log.gz 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48680.log 2024-09-16T14:40:10.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53894.log 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38354.log.gz 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56360.log 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.48680.log.gz 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43206.log 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53894.log.gz 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55216.log 2024-09-16T14:40:10.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56360.log.gz 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53873.log 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43206.log.gz 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55216.log.gz 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62649.log 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53873.log.gz 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2024-09-16T14:40:10.365 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62649.log.gz 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60959.log 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38565.log 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62210.log 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60959.log.gz 2024-09-16T14:40:10.366 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.38565.log: --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.38565.log.gz 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58489.log 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62210.log.gz 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55770.log 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44388.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58489.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58489.log.gz-5 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30690.log 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55770.log.gz 2024-09-16T14:40:10.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56965.log 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69040.log 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30690.log.gz 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71408.log 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56965.log.gz 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-09-16T14:40:10.368 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69040.log.gz 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43571.log 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71408.log.gz 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33550.log 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43571.log.gz 2024-09-16T14:40:10.369 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30669.log 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33550.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33550.log.gz 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.30669.log: --verbose -- /var/log/ceph/ceph-client.admin.36854.log 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30669.log.gz 2024-09-16T14:40:10.370 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25603.log 2024-09-16T14:40:10.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-09-16T14:40:10.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63603.log 2024-09-16T14:40:10.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36854.log.gz 2024-09-16T14:40:10.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-16T14:40:10.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25603.log.gz 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45392.log 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63603.log.gz 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45392.log.gz 2024-09-16T14:40:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65886.log 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53075.log 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65886.log.gz 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56382.log 2024-09-16T14:40:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43472.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56922.log 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53075.log.gz 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37976.log 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56382.log.gz 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57909.log 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56922.log.gz 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2024-09-16T14:40:10.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37976.log: gzip -5 --verbose 23.0%-- /var/log/ceph/ceph-client.admin.40347.log 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37976.log.gz 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57909.log: /var/log/ceph/ceph-client.admin.48102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57909.log.gz 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35936.log 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40347.log.gz 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69362.log 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35936.log.gz 2024-09-16T14:40:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67821.log 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54390.log 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69362.log.gz 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67821.log.gz 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55363.log 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54390.log.gz 2024-09-16T14:40:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.42461.log: --verbose -- /var/log/ceph/ceph-client.admin.34768.log 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32003.log 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55363.log.gz 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49323.log 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34768.log.gz 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35408.log 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32003.log: /var/log/ceph/ceph-client.admin.49323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52500.log 2024-09-16T14:40:10.377 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32003.log.gz 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49323.log.gz 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71652.log 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35408.log.gz 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52500.log.gz 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39552.log 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71652.log.gz 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26485.log 0.0% 2024-09-16T14:40:10.378 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57008.log 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39552.log: /var/log/ceph/ceph-client.admin.26485.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39552.log.gz 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58085.log 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26485.log.gz 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63292.log 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57008.log.gz 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29084.log 2024-09-16T14:40:10.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58085.log.gz 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28135.log 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63292.log.gz 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52163.log 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29084.log.gz 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64987.log 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28135.log.gz 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57158.log 2024-09-16T14:40:10.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52163.log.gz 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56793.log 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64987.log.gz 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.57158.log: --verbose -- /var/log/ceph/ceph-client.admin.44786.log 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57158.log.gz 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56793.log.gz 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44786.log.gz 2024-09-16T14:40:10.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47978.log 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47978.log.gz 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70649.log 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67169.log: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2024-09-16T14:40:10.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66058.log 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54088.log 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70649.log.gz 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31098.log 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66058.log.gz 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26442.log 2024-09-16T14:40:10.383 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54088.log.gz 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56480.log 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31098.log.gz 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55386.log 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26442.log.gz 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59596.log 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56480.log.gz 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34868.log 2024-09-16T14:40:10.384 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55386.log.gz 2024-09-16T14:40:10.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68525.log 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59596.log.gz 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40304.log 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34868.log.gz 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63274.log 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68525.log.gz 2024-09-16T14:40:10.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40046.log 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40304.log.gz 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46434.log 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63274.log.gz 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33652.log 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40046.log.gz 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65336.log 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46434.log.gz 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-09-16T14:40:10.989 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33652.log: /var/log/ceph/ceph-client.admin.65336.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33652.log.gz 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40154.log 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.65336.log.gz 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33227.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50708.log 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40154.log.gz 2024-09-16T14:40:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gz 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59144.log 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50708.log.gz 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27909.log 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59144.log.gz 2024-09-16T14:40:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58929.log 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26832.log 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27909.log.gz 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log /var/log/ceph/ceph-client.admin.58929.log: 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58929.log.gz 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26832.log.gz 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42444.log 2024-09-16T14:40:10.992 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36667.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31552.log: /var/log/ceph/ceph-client.admin.42444.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.36684.log 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31874.log 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-09-16T14:40:10.993 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39573.log 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72035.log 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31874.log: /var/log/ceph/ceph-client.admin.39573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59725.log 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31874.log.gz 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39573.log.gz 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72035.log.gz 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32411.log 2024-09-16T14:40:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59725.log.gz 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49065.log 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55921.log 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32411.log.gz 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30411.log 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65458.log 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55921.log.gz 2024-09-16T14:40:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30411.log.gz 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56681.log 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65458.log.gz 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56681.log.gz 2024-09-16T14:40:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32768.log 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20788.log 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37007.log 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32768.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32768.log.gz 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.20788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27891.log 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20788.log.gz 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2024-09-16T14:40:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37007.log: 0.0%/var/log/ceph/ceph-client.admin.27891.log: -- replaced with /var/log/ceph/ceph-client.admin.37007.log.gz 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32394.log 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27891.log.gz 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log: /var/log/ceph/ceph-client.admin.37041.log 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54196.log 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32394.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32394.log.gz 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45152.log 2024-09-16T14:40:10.998 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37041.log.gz 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51202.log 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54196.log.gz 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64820.log 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45152.log.gz 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40003.log 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51202.log.gz 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58736.log 2024-09-16T14:40:10.999 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64820.log.gz 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.40003.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54927.log 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40003.log.gz 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58736.log.gz 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62766.log 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54927.log.gz 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56007.log 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 2024-09-16T14:40:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28887.log 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62766.log.gz 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70376.log 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56007.log.gz 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.28887.log.gz 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53507.log 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70376.log.gz 2024-09-16T14:40:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54066.log 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66832.log 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53507.log.gz 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55426.log 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54066.log.gz 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34586.log 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66832.log.gz 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58368.log 2024-09-16T14:40:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55426.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.55426.log.gz 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29873.log 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34586.log.gz 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57788.log 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58368.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.58368.log.gz 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29873.log.gz 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57788.log.gz 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68611.log 2024-09-16T14:40:11.003 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62747.log 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50494.log 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68611.log.gz 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28694.log 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62747.log.gz 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68889.log 2024-09-16T14:40:11.004 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50494.log.gz 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39027.log 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28694.log.gz 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68889.log.gz 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62428.log 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39027.log.gz 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32836.log: /var/log/ceph/ceph-client.admin.43592.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-09-16T14:40:11.005 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26746.log 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62428.log.gz 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48208.log 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49668.log: /var/log/ceph/ceph-client.admin.26746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61446.log 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26746.log.gz 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48208.log.gz 2024-09-16T14:40:11.006 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66875.log 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61446.log.gz 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50579.log 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66875.log.gz 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34968.log 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29380.log 2024-09-16T14:40:11.007 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50579.log.gz 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55985.log 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34968.log.gz 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67944.log 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29380.log.gz 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55985.log.gz 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65950.log 2024-09-16T14:40:11.008 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67944.log.gz 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47443.log 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65950.log.gz 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58389.log 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72468.log 2024-09-16T14:40:11.009 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47443.log.gz 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58389.log.gz 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37468.log 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72468.log.gz 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26506.log 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.37468.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36582.log 2024-09-16T14:40:11.010 INFO:teuthology.orchestra.run.smithi137.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.37468.log.gz 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67397.log 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26506.log.gz 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68847.log 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36582.log.gz 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39874.log 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67397.log.gz 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-09-16T14:40:11.011 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68847.log.gz 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69298.log 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39874.log.gz 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62113.log 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69298.log.gz 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2024-09-16T14:40:11.012 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70867.log 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.62113.log.gz 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69534.log 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70867.log.gz 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-09-16T14:40:11.013 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69534.log.gz 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60164.log 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39321.log 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29030.log 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60164.log.gz 2024-09-16T14:40:11.014 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27238.log 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50880.log 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29030.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39321.log.gz 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29030.log.gz 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57244.log 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27238.log.gz 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49582.log 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50880.log.gz 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32870.log 2024-09-16T14:40:11.015 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57244.log.gz 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60030.log 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49582.log.gz 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67880.log 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32870.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32870.log.gz 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56305.log 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60030.log.gz 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56771.log 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67880.log.gz 2024-09-16T14:40:11.016 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56305.log.gz 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30518.log 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56771.log.gz 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25773.log 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63723.log 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30518.log.gz 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38186.log 2024-09-16T14:40:11.017 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25773.log.gz 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64369.log 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63723.log.gz 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38186.log: gzip -5 /var/log/ceph/ceph-client.admin.64369.log: --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38186.log.gz 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64369.log.gz 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27455.log 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48829.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28073.log 2024-09-16T14:40:11.018 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27455.log.gz 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47654.log 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28073.log.gz 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.47654.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47654.log.gz 2024-09-16T14:40:11.019 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26356.log 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32496.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59359.log 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26356.log.gz 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72414.log 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59359.log: 29.5% -- replaced with /var/log/ceph/ceph-client.admin.59359.log.gz 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34666.log 2024-09-16T14:40:11.020 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72414.log.gz 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67860.log 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34666.log.gz 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33686.log 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2024-09-16T14:40:11.021 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63489.log 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67860.log.gz 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47314.log 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33686.log.gz 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63489.log.gz 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51181.log 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47314.log.gz 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33846.log 2024-09-16T14:40:11.022 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32955.log 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51181.log.gz 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59381.log 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57330.log 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33846.log.gz 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61581.log 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32955.log.gz 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59381.log.gz 2024-09-16T14:40:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57330.log.gz 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28522.log 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61581.log.gz 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46948.log 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33244.log 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28522.log.gz 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40089.log 2024-09-16T14:40:11.024 INFO:teuthology.orchestra.run.smithi137.stderr: 26.2% -- replaced with /var/log/ceph/ceph-client.admin.46948.log.gz 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39939.log 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33244.log: 2.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.33244.log.gz--verbose -- 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41656.log 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38060.log 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40089.log.gz 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39939.log.gz 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65929.log 2024-09-16T14:40:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.38060.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55280.log 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38060.log.gz 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46621.log 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65929.log.gz 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40368.log 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55280.log.gz 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2024-09-16T14:40:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66488.log 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40368.log.gz 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57770.log 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66488.log.gz 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28845.log 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57770.log.gz 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-09-16T14:40:11.027 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59123.log 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28845.log.gz 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63449.log 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 2.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz/var/log/ceph/ceph-client.admin.70949.log 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59123.log.gz 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27132.log 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63449.log: /var/log/ceph/ceph-client.admin.70949.log: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.63449.log.gz 2024-09-16T14:40:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51647.log 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70949.log.gz 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37296.log 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27132.log.gz 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51647.log.gz 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37296.log.gz 2024-09-16T14:40:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68975.log 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58064.log 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68975.log.gz 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58263.log 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-09-16T14:40:11.030 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49818.log 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58064.log.gz 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61325.log 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58263.log.gz 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49818.log.gz 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61325.log.gz 2024-09-16T14:40:11.031 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35588.log 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35268.log 2024-09-16T14:40:11.032 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35588.log.gz 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30045.log 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63843.log 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35268.log.gz 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53916.log 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30045.log.gz 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63843.log: /var/log/ceph/ceph-client.admin.56238.log 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.63843.log.gz 2024-09-16T14:40:11.033 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62957.log 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53916.log.gz 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39510.log 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62957.log.gz 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58469.log 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.39510.log.gz 2024-09-16T14:40:11.034 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36752.log 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44088.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gz 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53959.log 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58469.log.gz 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.36752.log: -- /var/log/ceph/ceph-client.admin.50012.log 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36752.log.gz 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40240.log 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53959.log.gz 2024-09-16T14:40:11.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52520.log 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60496.log 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40240.log.gz 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69276.log 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52520.log.gz 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50306.log 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60496.log.gz 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40426.log 2024-09-16T14:40:11.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69276.log.gz 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60185.log 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50306.log.gz 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60826.log 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40426.log.gz 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25336.log 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60185.log.gz 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2024-09-16T14:40:11.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60826.log.gz 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67605.log 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25336.log.gz 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30368.log 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36208.log 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67605.log.gz 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61367.log /var/log/ceph/ceph-client.admin.30368.log: 2024-09-16T14:40:11.038 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30368.log.gz 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28436.log 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36208.log.gz 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.61367.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29530.log 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61367.log.gz 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41580.log 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28436.log.gz 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29530.log.gz 2024-09-16T14:40:11.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41580.log.gz 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53051.log 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68760.log 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2024-09-16T14:40:11.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38039.log 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68760.log: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.68760.log.gz 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31789.log 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38039.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38039.log.gz 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49947.log 2024-09-16T14:40:11.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31789.log.gz 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39982.log 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49947.log.gz 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65067.log 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39982.log.gz 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29573.log 2024-09-16T14:40:11.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.65067.log.gz 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29573.log.gz 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37194.log 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31230.log 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38123.log: /var/log/ceph/ceph-client.admin.37194.log: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-09-16T14:40:11.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59037.log 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37194.log.gz 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31230.log.gz 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46188.log 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59037.log.gz 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30647.log 2024-09-16T14:40:11.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32037.log 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46188.log.gz 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30647.log.gz 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69255.log 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32037.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32037.log.gz 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65544.log 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-09-16T14:40:11.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51668.log 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69255.log.gz 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64885.log 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65544.log.gz 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51668.log.gz 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64885.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64885.log.gz 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.31132.log 2024-09-16T14:40:11.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25630.log 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50222.log 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31132.log.gz 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64080.log 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25630.log.gz 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72143.log /var/log/ceph/ceph-client.admin.50222.log: 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50222.log.gz 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32853.log 2024-09-16T14:40:11.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64080.log.gz 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31853.log 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72143.log.gz 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38481.log 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32853.log.gz 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.31853.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62940.log 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31853.log.gz 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61055.log 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38481.log: /var/log/ceph/ceph-client.admin.62940.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38481.log.gz 2024-09-16T14:40:11.048 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62940.log.gz 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71219.log 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44679.log 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61055.log: /var/log/ceph/ceph-client.admin.71219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61055.log.gz 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71219.log.gz 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26896.log 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44679.log.gz 2024-09-16T14:40:11.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26896.log.gz 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56879.log 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62037.log 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55300.log 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56879.log.gz 2024-09-16T14:40:11.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71354.log 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62037.log.gz 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68503.log 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55300.log.gz 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71354.log.gz 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.68503.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42142.log 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68503.log.gz 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-09-16T14:40:11.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28157.log 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42142.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.42142.log.gz 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46364.log 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34046.log 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28157.log.gz 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66402.log 2024-09-16T14:40:11.052 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46364.log.gz 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42303.log 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34046.log.gz 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37703.log 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66402.log.gz 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42303.log.gz 2024-09-16T14:40:11.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37703.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37703.log.gz 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44657.log 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46310.log: /var/log/ceph/ceph-client.admin.49732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26789.log 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44657.log.gz 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-09-16T14:40:11.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45972.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.58162.log -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26789.log.gz 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58162.log.gz 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63197.log 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2024-09-16T14:40:11.055 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39405.log 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42424.log: /var/log/ceph/ceph-client.admin.63197.log: 58.3% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55598.log 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.63197.log.gz 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59015.log 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39405.log.gz 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58241.log 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55598.log.gz 2024-09-16T14:40:11.056 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35885.log 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59015.log.gz 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58241.log.gz 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37597.log 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35885.log.gz 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69767.log 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2024-09-16T14:40:11.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55792.log 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37597.log.gz 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29830.log 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69767.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69767.log.gz 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55792.log.gz 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36599.log 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29830.log.gz 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-09-16T14:40:11.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60942.log 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36599.log.gz 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28802.log 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70676.log 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60942.log.gz 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57029.log 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28802.log.gz 2024-09-16T14:40:11.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70676.log.gz 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70349.log 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57029.log.gz 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65377.log 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41904.log: /var/log/ceph/ceph-client.admin.70349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40068.log 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70349.log.gz 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27663.log 2024-09-16T14:40:11.060 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65377.log.gz 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69341.log 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40068.log.gz 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60515.log 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27663.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27663.log.gz 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37513.log 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69341.log.gz 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60515.log: /var/log/ceph/ceph-client.admin.47856.log 2024-09-16T14:40:11.061 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60515.log.gz 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37513.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37513.log.gz 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31251.log 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47856.log.gz 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56559.log 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36140.log 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31251.log.gz 2024-09-16T14:40:11.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58281.log 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56559.log.gz 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61136.log 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36140.log.gz 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58281.log.gz 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58509.log 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61136.log.gz 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57892.log 2024-09-16T14:40:11.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70811.log 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68740.log 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58509.log.gz 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57892.log.gz 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39960.log 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70811.log.gz 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35783.log 2024-09-16T14:40:11.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68740.log.gz 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54497.log 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39960.log.gz 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.35783.log: --verbose -- /var/log/ceph/ceph-client.admin.29981.log 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35783.log.gz 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46538.log 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54497.log.gz 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53115.log 2024-09-16T14:40:11.065 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29981.log.gz 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46538.log.gz 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66982.log 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53115.log.gz 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54583.log 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68546.log 2024-09-16T14:40:11.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66982.log.gz 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68675.log 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54583.log.gz 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68546.log.gz 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52437.log 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68675.log.gz 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54282.log 2024-09-16T14:40:11.067 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66660.log 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52437.log.gz 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54282.log.gz 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66660.log.gz 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65152.log 2024-09-16T14:40:11.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44937.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.51969.log -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68954.log 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65152.log.gz 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67249.log 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51969.log.gz 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51009.log 2024-09-16T14:40:11.069 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68954.log.gz 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67800.log 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67249.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.67249.log.gz-5 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.43311.log 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51009.log: /var/log/ceph/ceph-client.admin.67800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51009.log.gz 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45822.log 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.67800.log.gz 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28904.log 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2024-09-16T14:40:11.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50622.log 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45822.log.gz 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28904.log.gz 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33482.log 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50622.log.gz 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63097.log 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2024-09-16T14:40:11.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29208.log 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33482.log: /var/log/ceph/ceph-client.admin.63097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63097.log.gz 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33482.log.gz 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29208.log.gz 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-09-16T14:40:11.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29358.log 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30153.log 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41946.log 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29358.log.gz 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30497.log 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30153.log.gz 2024-09-16T14:40:11.073 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41946.log.gz 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61956.log 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30497.log.gz 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.45109.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61956.log.gz 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32207.log 2024-09-16T14:40:11.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34748.log 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32207.log.gz 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43790.log 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34748.log.gz 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66939.log 2024-09-16T14:40:11.075 INFO:teuthology.orchestra.run.smithi137.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43790.log.gz 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39468.log 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66939.log.gz 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41965.log 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71896.log 2024-09-16T14:40:11.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63117.log 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39468.log.gz 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63506.log 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41965.log.gz 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71896.log.gz 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57352.log 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63117.log.gz 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2024-09-16T14:40:11.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63506.log.gz 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29659.log 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57352.log.gz 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57180.log 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29659.log.gz 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57669.log 2024-09-16T14:40:11.078 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57180.log.gz 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45044.log 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57669.log.gz 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34266.log 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45044.log.gz 2024-09-16T14:40:11.079 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34266.log.gz 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32360.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58220.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48957.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64136.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41274.log 2024-09-16T14:40:11.080 INFO:teuthology.orchestra.run.smithi137.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32360.log.gz 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.58220.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52357.log 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64136.log.gz 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58220.log.gz 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41274.log: /var/log/ceph/ceph-client.admin.52357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35970.log 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41274.log.gz 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52357.log.gz 2024-09-16T14:40:11.081 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56028.log 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38523.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35970.log.gz 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55469.log 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56028.log.gz 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31273.log 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-09-16T14:40:11.082 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58183.log 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55469.log.gz 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45023.log 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31273.log.gz 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31617.log 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58183.log.gz 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66036.log 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45023.log.gz 2024-09-16T14:40:11.083 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69748.log 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31617.log.gz 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.66036.log: --verbose -- /var/log/ceph/ceph-client.admin.39702.log 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66036.log.gz 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69748.log.gz 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39702.log.gz 2024-09-16T14:40:11.084 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63824.log 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34326.log 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63824.log.gz 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62880.log 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log 2024-09-16T14:40:11.085 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34326.log.gz 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69660.log 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62880.log.gz 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log: /var/log/ceph/ceph-client.admin.60302.log 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54304.log.gz 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32598.log 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69660.log.gz 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71926.log 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60302.log.gz 2024-09-16T14:40:11.086 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31294.log 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32598.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32598.log.gz 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32428.log 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71926.log: 0.0%/var/log/ceph/ceph-client.admin.31294.log: -- replaced with /var/log/ceph/ceph-client.admin.71926.log.gz 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31294.log.gz 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20886.log 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41553.log 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32428.log.gz 2024-09-16T14:40:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63663.log 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.20886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20886.log.gz 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70322.log 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41553.log.gz 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63663.log.gz 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70322.log.gz 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-09-16T14:40:11.088 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61408.log 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46293.log 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33601.log: /var/log/ceph/ceph-client.admin.61408.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64670.log 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61408.log.gz 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2024-09-16T14:40:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46293.log.gz 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30131.log 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64670.log.gz 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71490.log 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30131.log.gz 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67901.log 2024-09-16T14:40:11.090 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53422.log: 23.1%/var/log/ceph/ceph-client.admin.71490.log: -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54540.log 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71490.log.gz 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53401.log 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67901.log.gz 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.54540.log: --verbose -- /var/log/ceph/ceph-client.admin.59897.log 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54540.log.gz 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.53401.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2024-09-16T14:40:11.091 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53401.log.gz 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62018.log 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59897.log.gz 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42978.log 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25692.log 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62018.log.gz 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42978.log.gz 2024-09-16T14:40:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44047.log 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25692.log.gz 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44047.log: gzip -5 /var/log/ceph/ceph-client.admin.36735.log: --verbose -- /var/log/ceph/ceph-client.admin.34908.log 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44047.log.gz 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2024-09-16T14:40:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51433.log 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34908.log.gz 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46503.log 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29766.log 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.51433.log.gz 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57690.log.gz 2024-09-16T14:40:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46503.log.gz 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55813.log 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29766.log.gz 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60475.log 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55813.log.gz 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40560.log 2024-09-16T14:40:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60475.log.gz 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.33635.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28243.log 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28243.log.gz 2024-09-16T14:40:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53744.log 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21065.log 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53744.log.gz 2024-09-16T14:40:11.097 INFO:teuthology.orchestra.run.smithi137.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-09-16T14:40:11.100 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2024-09-16T14:40:11.100 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-09-16T14:40:11.100 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.21065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64519.log 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.21065.log.gz 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.40579.log: --verbose -- /var/log/ceph/ceph-client.admin.36446.log 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28630.log 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47918.log 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64519.log.gz 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36446.log.gz 2024-09-16T14:40:11.101 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.28630.log: --verbose -- /var/log/ceph/ceph-client.admin.42066.log 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28630.log.gz 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51905.log 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47918.log.gz 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37934.log 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42066.log.gz 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33108.log 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51905.log.gz 2024-09-16T14:40:11.102 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61076.log 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37934.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.37934.log.gz 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.33108.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37724.log 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33108.log.gz 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61076.log.gz 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37724.log.gz 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72197.log 2024-09-16T14:40:11.103 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.38901.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63623.log 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31359.log 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72197.log.gz 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48722.log 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63623.log.gz 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71138.log 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-09-16T14:40:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28941.log 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48722.log.gz 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54152.log 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71138.log.gz 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70403.log 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.28941.log.gz 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.54152.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54152.log.gz 2024-09-16T14:40:11.105 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33074.log 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70403.log.gz 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39216.log 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64018.log 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33074.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33074.log.gz 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67541.log 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39216.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39216.log.gz 2024-09-16T14:40:11.106 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68719.log 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64018.log.gz 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67541.log.gz 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68719.log: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.68719.log.gz 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25766.log 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2024-09-16T14:40:11.107 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33806.log 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25766.log.gz 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55343.log 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33806.log.gz 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46257.log 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38207.log: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-09-16T14:40:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58575.log 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55343.log.gz 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27797.log 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46257.log.gz 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67356.log 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58575.log.gz 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68245.log 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70135.log 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27797.log.gz 2024-09-16T14:40:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67356.log.gz 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72116.log 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68245.log.gz 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41081.log 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70135.log.gz 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72116.log.gz 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43184.log 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41081.log.gz 2024-09-16T14:40:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31960.log 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67839.log 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43184.log: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.43184.log.gz 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31960.log.gz 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57870.log 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-09-16T14:40:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67839.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.67839.log.gz 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57870.log.gz 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52865.log 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67229.log 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61698.log 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52865.log.gz 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69384.log 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67229.log.gz 2024-09-16T14:40:11.112 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63409.log 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61698.log.gz 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52886.log 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69384.log.gz 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50837.log 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63409.log.gz 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 0.0% 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52886.log.gz 2024-09-16T14:40:11.113 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41339.log 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50837.log.gz 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51948.log 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43021.log: 50.2% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59338.log 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41339.log.gz 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53701.log 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51948.log.gz 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61386.log 2024-09-16T14:40:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59338.log.gz 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34848.log 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53701.log.gz 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60121.log 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.61386.log.gz 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34848.log.gz 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39069.log 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60121.log.gz 2024-09-16T14:40:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61821.log 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.39069.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39069.log.gz 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61821.log.gz 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63332.log 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2024-09-16T14:40:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35368.log 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66445.log 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.63332.log.gz 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35368.log.gz 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66445.log.gz 2024-09-16T14:40:11.117 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66015.log 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46682.log 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66015.log.gz 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59617.log 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30925.log 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-09-16T14:40:11.118 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26463.log 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59617.log.gz 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.30925.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30024.log 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30925.log.gz 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26463.log: /var/log/ceph/ceph-client.admin.29852.log 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26463.log.gz 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-09-16T14:40:11.119 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30024.log.gz 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29852.log.gz 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71815.log 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.71815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71815.log.gz 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58025.log 2024-09-16T14:40:11.120 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69912.log 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55491.log 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58025.log.gz 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33159.log 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69912.log.gz 2024-09-16T14:40:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54965.log 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55491.log.gz 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29701.log 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33159.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33159.log.gz 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42586.log 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54965.log.gz 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29701.log.gz 2024-09-16T14:40:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42586.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz--verbose -- 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71953.log 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39531.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70757.log 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37682.log: 23.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz--verbose 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:-- /var/log/ceph/ceph-client.admin.65564.log 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71953.log.gz 2024-09-16T14:40:11.123 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72170.log 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70757.log.gz 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45216.log 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65564.log.gz 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41425.log 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72170.log.gz 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27473.log 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45216.log.gz 2024-09-16T14:40:11.124 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61464.log 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41425.log.gz 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51288.log 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27473.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27473.log.gz 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37279.log 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61464.log.gz 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66079.log 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51288.log.gz 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38333.log 2024-09-16T14:40:11.125 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37279.log.gz 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39810.log 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66079.log.gz 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57287.log 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38333.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38333.log.gz 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39810.log.gz 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43249.log 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57287.log.gz 2024-09-16T14:40:11.126 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32309.log 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43249.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.43249.log.gz 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31035.log 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39342.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62725.log 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42646.log 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32309.log.gz 2024-09-16T14:40:11.127 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40973.log 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31035.log.gz 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.62725.log.gz 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.42646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66789.log 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gz 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65027.log 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40973.log.gz 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66789.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66789.log.gz-5 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.71869.log 2024-09-16T14:40:11.128 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71381.log 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65027.log.gz 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42956.log 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71869.log.gz 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64156.log 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71381.log.gz 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52661.log 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42956.log: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.42956.log.gz 2024-09-16T14:40:11.129 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36633.log 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64156.log.gz 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52661.log: 0.0%/var/log/ceph/ceph-client.admin.36633.log: -- replaced with /var/log/ceph/ceph-client.admin.52661.log.gz 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67438.log 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36633.log.gz 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33966.log 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66165.log 2024-09-16T14:40:11.130 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67438.log.gz 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47099.log 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33966.log.gz 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54605.log 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66165.log.gz 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59789.log 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47099.log.gz 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60722.log 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54605.log.gz 2024-09-16T14:40:11.131 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27947.log 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59789.log.gz 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60722.log.gz 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26614.log 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27947.log.gz 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68782.log 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-16T14:40:11.132 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68288.log 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26614.log.gz 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59811.log 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68782.log.gz 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36191.log 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68288.log.gz 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55175.log 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59811.log.gz 2024-09-16T14:40:11.133 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36191.log.gz 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72062.log 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55175.log.gz 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58671.log 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44350.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64863.log 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72062.log.gz 2024-09-16T14:40:11.134 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58671.log.gz 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27378.log 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64863.log.gz 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57051.log 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26528.log 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27378.log.gz 2024-09-16T14:40:11.135 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48062.log 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57051.log.gz 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66681.log 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26528.log.gz 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48062.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.48062.log.gz 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52619.log 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66681.log.gz 2024-09-16T14:40:11.136 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32802.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.52619.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33346.log 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52619.log.gz 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.54712.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50200.log 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27721.log 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33346.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33346.log.gz 2024-09-16T14:40:11.137 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67417.log 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50200.log.gz 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27721.log.gz 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71057.log 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67417.log.gz 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64058.log 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2024-09-16T14:40:11.138 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71057.log.gz 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64058.log: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.64058.log.gz 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36718.log 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50369.log 2024-09-16T14:40:11.139 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36718.log.gz 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48373.log 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50369.log.gz 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67722.log 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28393.log 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48373.log.gz 2024-09-16T14:40:11.140 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59854.log 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52762.log 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28393.log.gz 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31380.log 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59854.log.gz 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.52762.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27372.log 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52762.log.gz 2024-09-16T14:40:11.141 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31380.log.gz 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60923.log 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27372.log.gz 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27511.log 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43550.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29294.log 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60923.log.gz 2024-09-16T14:40:11.142 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48394.log 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27511.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27511.log.gz 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26875.log 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29294.log.gz 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59488.log 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48394.log.gz 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65315.log 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26875.log.gz 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30995.log 2024-09-16T14:40:11.143 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59488.log.gz 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39300.log 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65315.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.65315.log.gz 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30995.log.gz 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56900.log 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log: /var/log/ceph/ceph-client.admin.53177.log 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.39300.log.gz 2024-09-16T14:40:11.144 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56900.log.gz 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gzgzip 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.52417.log 2024-09-16T14:40:11.145 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66724.log 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52417.log.gz 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26191.log 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66724.log.gz 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70457.log 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-09-16T14:40:11.146 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61117.log 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26191.log.gz 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.70457.log: -- /var/log/ceph/ceph-client.admin.36973.log 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70457.log.gz 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61117.log.gz 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45671.log 2024-09-16T14:40:11.147 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36973.log.gz 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52249.log 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42710.log 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45671.log.gz 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39258.log 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52249.log.gz 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42710.log.gz 2024-09-16T14:40:11.148 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30260.log 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39258.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.39258.log.gz 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52055.log 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30260.log.gz 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53241.log 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-09-16T14:40:11.149 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56836.log 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52055.log.gz 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.53241.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.53241.log.gz 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35851.log 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56836.log.gz 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34206.log 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39767.log 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35851.log.gz 2024-09-16T14:40:11.150 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34206.log.gz 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48701.log 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39767.log.gz 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log: /var/log/ceph/ceph-client.admin.61738.log 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55534.log 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48701.log.gz 2024-09-16T14:40:11.151 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27397.log 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61738.log.gz 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66574.log 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55534.log.gz 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40844.log 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27397.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27397.log.gz 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71111.log 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66574.log.gz 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40844.log.gz 2024-09-16T14:40:11.152 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71111.log.gz 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67782.log 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29102.log 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59682.log 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67782.log: /var/log/ceph/ceph-client.admin.29102.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.67782.log.gz--verbose 2024-09-16T14:40:11.153 INFO:teuthology.orchestra.run.smithi137.stderr:-- /var/log/ceph/ceph-client.admin.35953.log 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29102.log.gz 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59682.log.gz 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32071.log 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35953.log.gz 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27739.log 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67742.log 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-09-16T14:40:11.154 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32071.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32071.log.gz 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38817.log 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27739.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27739.log.gz 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64713.log 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67742.log: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.67742.log.gz 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.38817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56050.log 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38817.log.gz 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64713.log.gz 2024-09-16T14:40:11.155 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53980.log 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56050.log.gz 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64605.log 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53980.log.gz 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63546.log 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33722.log: 52.6% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48765.log 2024-09-16T14:40:11.156 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64605.log.gz 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63546.log.gz 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48765.log.gz 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40718.log 2024-09-16T14:40:11.157 INFO:teuthology.orchestra.run.smithi137.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27376.log 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20973.log 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59402.log 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27376.log.gz 2024-09-16T14:40:11.158 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20973.log: /var/log/ceph/ceph-client.admin.61758.log 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr: 28.5% -- replaced with /var/log/ceph/ceph-client.admin.20973.log.gz 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70514.log 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59402.log.gz 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.61758.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27569.log 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61758.log.gz 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72386.log 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70514.log.gz 2024-09-16T14:40:11.159 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31746.log 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27569.log.gz 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72386.log.gz 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66316.log 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31746.log.gz 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51413.log: gzip /var/log/ceph/ceph-client.admin.66316.log: -5 --verbose -- 55.9%/var/log/ceph/ceph-client.admin.61427.log -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-09-16T14:40:11.160 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66316.log.gz 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.48808.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52297.log 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61427.log.gz 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49711.log 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52297.log.gz 2024-09-16T14:40:11.161 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42225.log 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49711.log.gz 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.42225.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57809.log 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.42225.log.gz 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47835.log 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2024-09-16T14:40:11.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29509.log 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57809.log.gz 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68138.log 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47835.log.gz 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29509.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29509.log.gz-5 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.32972.log 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28458.log 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68138.log.gz 2024-09-16T14:40:11.163 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32972.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32972.log.gz 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51819.log 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28458.log.gz 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30905.log 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38775.log 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51819.log.gz 2024-09-16T14:40:11.164 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51309.log 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30905.log.gz 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29487.log 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.38775.log.gz 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35628.log 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51309.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.51309.log.gz 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59230.log 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29487.log.gz 2024-09-16T14:40:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60996.log 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35628.log.gz 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38502.log 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59230.log.gz 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60996.log.gz 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36905.log 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38502.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.38502.log.gz 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46819.log 2024-09-16T14:40:11.166 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36905.log.gz 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46819.log.gz 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28866.log 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36395.log 2024-09-16T14:40:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43926.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38586.log 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28866.log.gz 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66251.log 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36395.log.gz 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28544.log 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38586.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38586.log.gz 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54045.log 2024-09-16T14:40:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66251.log.gz 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70541.log 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28544.log.gz 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.54045.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27294.log 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54045.log.gz 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31077.log 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70541.log.gz 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27294.log.gz 2024-09-16T14:40:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29164.log 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31077.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.31077.log.gz 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63178.log 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38838.log 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29164.log.gz 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57459.log 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63178.log.gz 2024-09-16T14:40:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38838.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38838.log.gz 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29272.log 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57459.log.gz 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.46451.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27991.log 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65757.log 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29272.log.gz 2024-09-16T14:40:11.171 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27991.log.gz 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31574.log 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65757.log.gz 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27417.log 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31574.log.gz 2024-09-16T14:40:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62997.log 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27417.log.gz 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58409.log 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.62997.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35568.log 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62997.log.gz 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58409.log.gz 2024-09-16T14:40:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60845.log 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35568.log.gz 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47507.log 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60845.log.gz 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67315.log 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47507.log.gz 2024-09-16T14:40:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63313.log 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28673.log 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67315.log: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.67315.log.gz 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64197.log 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63313.log.gz 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59639.log 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28673.log.gz 2024-09-16T14:40:11.175 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64197.log.gz 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59639.log.gz 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36378.log 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29638.log 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-09-16T14:40:11.176 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36378.log.gz 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57416.log 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29638.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.29638.log.gz-- 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55448.log 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64799.log 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57416.log.gz 2024-09-16T14:40:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69405.log 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55448.log.gz 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64799.log.gz 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69405.log.gz 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56460.log 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38165.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32445.log 2024-09-16T14:40:11.178 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70622.log 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56460.log.gz 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29003.log 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32445.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32445.log.gz 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50815.log 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70622.log.gz 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68460.log 2024-09-16T14:40:11.179 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29003.log.gz 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41842.log 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50815.log.gz 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68460.log.gz 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26635.log 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41842.log.gz 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-09-16T14:40:11.180 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26635.log.gz 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26918.log 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26657.log /var/log/ceph/ceph-client.admin.36888.log: 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49237.log 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26918.log.gz 2024-09-16T14:40:11.181 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26657.log.gz 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70487.log 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49237.log.gz 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57497.log 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52804.log 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70487.log.gz 2024-09-16T14:40:11.182 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61193.log 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57497.log.gz 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46755.log 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52804.log.gz 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57309.log 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61193.log.gz 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70295.log 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46755.log.gz 2024-09-16T14:40:11.183 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64261.log 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57309.log.gz 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70295.log.gz 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64261.log.gz 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26061.log 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2024-09-16T14:40:11.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32241.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63158.log 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26061.log.gz 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67584.log 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61505.log 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63158.log.gz 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61678.log 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.67584.log.gz 2024-09-16T14:40:11.185 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61505.log.gz 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41188.log 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61678.log.gz 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58886.log 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41188.log.gz 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58886.log.gz 2024-09-16T14:40:11.186 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35448.log 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51457.log: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29959.log 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35448.log.gz 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29959.log: /var/log/ceph/ceph-client.admin.32683.log 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29959.log.gz 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62667.log 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-09-16T14:40:11.187 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47228.log 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32683.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32683.log.gz 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.62667.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62667.log.gz 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44593.log 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47228.log.gz 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48979.log 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-09-16T14:40:11.188 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44593.log.gz 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53722.log 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48979.log.gz 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53722.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53722.log.gz 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37449.log 2024-09-16T14:40:11.189 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38312.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.40758.log: -- /var/log/ceph/ceph-client.admin.70703.log 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56857.log 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37449.log.gz 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.70703.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70703.log.gz 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60764.log 2024-09-16T14:40:11.190 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56857.log.gz 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67189.log 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43331.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gz 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60764.log.gz 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67189.log.gz 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54626.log 2024-09-16T14:40:11.191 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57514.log 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30864.log 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54626.log.gz 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57514.log.gz 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.30864.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59467.log 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30864.log.gz 2024-09-16T14:40:11.192 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33295.log: gzip 1.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz--verbose 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:-- /var/log/ceph/ceph-client.admin.49840.log 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59467.log.gz 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41296.log 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2024-09-16T14:40:11.193 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25981.log 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41296.log.gz 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55856.log 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28307.log 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25981.log.gz 2024-09-16T14:40:11.194 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55856.log.gz 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59832.log 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28307.log.gz 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46167.log 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72359.log 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59832.log.gz 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67622.log 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46167.log.gz 2024-09-16T14:40:11.195 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69556.log 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72359.log: 26.5%/var/log/ceph/ceph-client.admin.67622.log: -- replaced with /var/log/ceph/ceph-client.admin.72359.log.gz 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67622.log.gz 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41822.log 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69556.log: /var/log/ceph/ceph-client.admin.32904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69556.log.gz 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27701.log 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30885.log 2024-09-16T14:40:11.196 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41822.log.gz 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41863.log 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27701.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27701.log.gz 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30885.log.gz 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39426.log 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.41863.log.gz 2024-09-16T14:40:11.197 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61861.log 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39426.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39426.log.gz 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55555.log 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45435.log 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61861.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.61861.log.gz 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.55555.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57395.log 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55555.log.gz 2024-09-16T14:40:11.198 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31402.log 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45435.log.gz 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30346.log 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57395.log.gz 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31402.log.gz 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62367.log 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30346.log.gz 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58951.log 2024-09-16T14:40:11.199 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33397.log 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62367.log.gz 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25852.log 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58951.log.gz 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66230.log 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33397.log.gz 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2024-09-16T14:40:11.200 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25852.log.gz 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66230.log.gz 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58613.log 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27157.log 2024-09-16T14:40:11.201 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63373.log 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58613.log.gz 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27929.log 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27157.log.gz 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59295.log 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63373.log.gz 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65628.log 2024-09-16T14:40:11.202 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27929.log.gz 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70430.log 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59295.log.gz 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52012.log 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65628.log.gz 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68181.log 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70430.log.gz 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-09-16T14:40:11.203 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52012.log.gz 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68181.log.gz 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62073.log 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67047.log 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62073.log.gz 2024-09-16T14:40:11.204 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65235.log 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67047.log.gz 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36939.log 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65235.log.gz 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39853.log 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36939.log.gz 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62844.log 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40502.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-09-16T14:40:11.205 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54325.log 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39853.log.gz 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62844.log.gz 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54325.log.gz 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47486.log 2024-09-16T14:40:11.206 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65047.log 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31423.log 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47486.log.gz 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65047.log.gz 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60864.log 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31423.log.gz 2024-09-16T14:40:11.207 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49754.log 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37492.log 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60864.log.gz 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36803.log 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49754.log.gz 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37492.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37492.log.gz 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71436.log 2024-09-16T14:40:11.208 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36803.log.gz 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.44308.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63945.log 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27332.log 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71436.log.gz 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53031.log 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63945.log.gz 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40930.log 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27332.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27332.log.gz 2024-09-16T14:40:11.209 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37808.log 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53031.log.gz 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32275.log 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40930.log.gz 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37871.log 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37808.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37808.log.gz 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64433.log 2024-09-16T14:40:11.210 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32275.log.gz 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37871.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.37871.log.gz 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36922.log 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64433.log.gz 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35548.log 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.36922.log: -- /var/log/ceph/ceph-client.admin.66509.log 2024-09-16T14:40:11.211 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36922.log.gz 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40780.log 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35548.log.gz 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70081.log 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66509.log.gz 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65993.log 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40780.log.gz 2024-09-16T14:40:11.212 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26853.log 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70081.log.gz 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65993.log.gz 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27025.log 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26853.log.gz 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56943.log 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33618.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gz 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54755.log 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27025.log.gz 2024-09-16T14:40:11.213 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69126.log 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56943.log.gz 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54755.log.gz 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50751.log 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69126.log.gz 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54002.log 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72441.log 2024-09-16T14:40:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37576.log 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54002.log.gz 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53765.log 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72441.log.gz 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37576.log: /var/log/ceph/ceph-client.admin.36174.log 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.37576.log.gz 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65295.log 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53765.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.53765.log.gz 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-09-16T14:40:11.215 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36174.log.gz 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65295.log: /var/log/ceph/ceph-client.admin.68826.log 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65295.log.gz 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58714.log 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30067.log 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68826.log: 55.4% -- replaced with /var/log/ceph/ceph-client.admin.68826.log.gz 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50923.log 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58714.log.gz 2024-09-16T14:40:11.216 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30067.log.gz 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32887.log 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50923.log.gz 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53529.log 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66144.log 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53529.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32887.log.gz 2024-09-16T14:40:11.217 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53529.log.gz 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56498.log 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66144.log.gz 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60340.log 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56498.log.gz 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27090.log 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60340.log.gz 2024-09-16T14:40:11.218 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27090.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27090.log.gz 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62685.log 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32326.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32785.log 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30942.log 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62685.log.gz 2024-09-16T14:40:11.219 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30977.log 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32785.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32785.log.gz 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59768.log 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30942.log.gz 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63982.log 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30977.log.gz 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38964.log 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59768.log.gz 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-09-16T14:40:11.220 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63982.log.gz 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58693.log 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38964.log.gz 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30196.log 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58693.log.gz 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44229.log 2024-09-16T14:40:11.221 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30196.log.gz 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44229.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.44229.log.gz 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44488.log 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33261.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2024-09-16T14:40:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63256.log 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29723.log 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.44488.log.gz 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63256.log.gz 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54863.log 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29723.log.gz 2024-09-16T14:40:11.223 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65972.log 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34346.log 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54863.log.gz 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56750.log 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65972.log.gz 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43410.log 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34346.log: /var/log/ceph/ceph-client.admin.56750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62977.log 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34346.log.gz 2024-09-16T14:40:11.224 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56750.log.gz 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53658.log 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43410.log: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.43410.log.gz 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62977.log.gz 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63804.log 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53658.log: /var/log/ceph/ceph-client.admin.44571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50643.log 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53658.log.gz 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-09-16T14:40:11.225 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32190.log 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63804.log.gz 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50643.log.gz 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48144.log 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32190.log.gz 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61214.log 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2024-09-16T14:40:11.226 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48144.log.gz 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41317.log 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61214.log.gz 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35668.log 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55071.log 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26571.log 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35668.log.gz 2024-09-16T14:40:11.227 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40025.log 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55071.log.gz 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26571.log.gz 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55577.log 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40025.log.gz 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50098.log 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39090.log: 23.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26420.log 2024-09-16T14:40:11.228 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55577.log.gz 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.50098.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28329.log 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50098.log.gz 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38922.log 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26420.log.gz 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28011.log 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28329.log.gz 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60688.log 2024-09-16T14:40:11.229 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38922.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38922.log.gz 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60532.log 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28011.log.gz 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62230.log 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60688.log.gz 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67702.log 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60532.log.gz 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60207.log 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62230.log.gz 2024-09-16T14:40:11.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64218.log 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67702.log.gz 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60207.log.gz 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62094.log 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64218.log.gz 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48743.log 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41718.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-09-16T14:40:11.231 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62094.log.gz 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61977.log 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48743.log.gz 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61658.log 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48082.log 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61977.log.gz 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29595.log 2024-09-16T14:40:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61658.log.gz 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.48082.log.gz 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29595.log.gz 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65397.log 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59660.log 2024-09-16T14:40:11.233 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32734.log 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65397.log.gz 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65735.log 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59660.log: /var/log/ceph/ceph-client.admin.32734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68052.log 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59660.log.gz 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32734.log.gz 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65735.log.gz 2024-09-16T14:40:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66853.log 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68052.log.gz 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60380.log 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66853.log.gz 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58908.log 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60380.log.gz 2024-09-16T14:40:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.53011.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63057.log 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30806.log 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58908.log.gz 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49258.log 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63057.log.gz 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44550.log 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30806.log.gz 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28587.log 2024-09-16T14:40:11.236 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49258.log.gz 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44550.log.gz 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68632.log 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28587.log.gz 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32462.log 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68632.log.gz 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27221.log 2024-09-16T14:40:11.237 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32462.log.gz 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26308.log 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62407.log 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27221.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27221.log.gz 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29142.log 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26308.log.gz 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.62407.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62407.log.gz 2024-09-16T14:40:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33329.log 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29142.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48332.log 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33329.log.gz 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57569.log 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39489.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62387.log 2024-09-16T14:40:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48332.log.gz 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29938.log 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57569.log.gz 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67662.log 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62387.log.gz 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.29938.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29938.log.gz 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58201.log 2024-09-16T14:40:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67662.log.gz 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.46101.log: --verbose -- /var/log/ceph/ceph-client.admin.62327.log 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58201.log.gz 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27370.log 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62327.log.gz 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-09-16T14:40:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27370.log.gz 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70189.log 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68911.log 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72332.log 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70189.log.gz 2024-09-16T14:40:11.242 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30788.log 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68911.log.gz 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67376.log 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72332.log.gz 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65255.log 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30788.log.gz 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67376.log.gz 2024-09-16T14:40:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62347.log 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65255.log.gz 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62347.log.gz 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69427.log 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68030.log 2024-09-16T14:40:11.244 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69427.log.gz 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68030.log.gz 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56071.log 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34706.log 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27759.log 2024-09-16T14:40:11.245 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56071.log.gz 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53550.log 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34706.log.gz 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68116.log 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27759.log.gz 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62571.log 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53550.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53550.log.gz 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59445.log 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68116.log.gz 2024-09-16T14:40:11.246 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64039.log 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62571.log.gz 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69750.log 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59445.log.gz 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45650.log 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64039.log.gz 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69750.log.gz 2024-09-16T14:40:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37892.log 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40677.log 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37892.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37892.log.gz 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46165.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.37381.log 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-09-16T14:40:11.248 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40677.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.40677.log.gz 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37381.log.gz 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43124.log 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26165.log 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66337.log 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43124.log.gz 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-09-16T14:40:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26165.log.gz 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34126.log 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66337.log.gz 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49904.log /var/log/ceph/ceph-client.admin.33040.log: 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34126.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.34126.log.gz 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67090.log 2024-09-16T14:40:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57708.log 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26592.log 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67090.log.gz 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43748.log 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57708.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.57708.log.gz-- 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65215.log 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26592.log.gz 2024-09-16T14:40:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71842.log 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43748.log.gz 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65215.log.gz 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31895.log 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71842.log.gz 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67966.log 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-09-16T14:40:11.252 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31895.log.gz 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60056.log 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27871.log 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67966.log.gz 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66896.log 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60056.log.gz 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38754.log 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27871.log.gz 2024-09-16T14:40:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62863.log 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66896.log.gz 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62631.log 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38754.log.gz 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63883.log 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62863.log.gz 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62631.log.gz 2024-09-16T14:40:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63883.log.gz 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59918.log 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43629.log: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38144.log 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59918.log.gz 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62612.log 2024-09-16T14:40:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38144.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38144.log.gz 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60573.log 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62612.log.gz 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37640.log 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2024-09-16T14:40:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60573.log.gz 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34566.log 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37640.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37640.log.gz 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29744.log 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69169.log 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34566.log.gz 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71761.log 2024-09-16T14:40:11.257 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29744.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.29744.log.gz 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58532.log 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69169.log.gz 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71761.log.gz 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58532.log: /var/log/ceph/ceph-client.admin.49775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66746.log 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58532.log.gz 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-09-16T14:40:11.258 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.46416.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40197.log 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39279.log 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66746.log: /var/log/ceph/ceph-client.admin.40197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66746.log.gz 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68224.log 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40197.log.gz 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58429.log 2024-09-16T14:40:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39279.log: /var/log/ceph/ceph-client.admin.68224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30239.log 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68224.log.gz 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39279.log.gz 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54454.log 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58429.log.gz 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28501.log 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30239.log: /var/log/ceph/ceph-client.admin.54454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30239.log.gz 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39132.log 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54454.log.gz 2024-09-16T14:40:11.260 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71192.log 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28501.log.gz 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29466.log 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39132.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.39132.log.gz 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32547.log 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71192.log.gz 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67209.log 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61034.log 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29466.log.gz 2024-09-16T14:40:11.261 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55942.log 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67209.log: 0.0% 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32547.log.gz 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67209.log.gz 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61034.log.gz 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55942.log.gz 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25657.log 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-09-16T14:40:11.262 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60902.log 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25657.log.gz 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41382.log 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60902.log.gz 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.34626.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-09-16T14:40:11.263 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41382.log.gz 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65907.log 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.43509.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34246.log 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34066.log 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65907.log.gz 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28759.log 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34246.log.gz 2024-09-16T14:40:11.264 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36310.log 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34066.log.gz 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.28759.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28759.log.gz 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36310.log.gz 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59510.log 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2024-09-16T14:40:11.265 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60004.log 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58006.log 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59510.log.gz 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60004.log.gz 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58006.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.48352.log -- replaced with /var/log/ceph/ceph-client.admin.58006.log.gz 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2024-09-16T14:40:11.266 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64906.log 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62590.log 2024-09-16T14:40:11.267 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64906.log.gz 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29122.log 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62247.log 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.62590.log.gz 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29122.log.gz 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62247.log.gzgzip 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.69788.log 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50119.log 2024-09-16T14:40:11.268 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69788.log.gz 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37534.log 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50119.log.gz 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.49797.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48659.log 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2024-09-16T14:40:11.269 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40866.log 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37534.log: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.37534.log.gz 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70922.log 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48659.log.gz 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65437.log 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40866.log.gz 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.70922.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70922.log.gz 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-09-16T14:40:11.270 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65437.log.gz 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44958.log 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36276.log: 0.0%/var/log/ceph/ceph-client.admin.44958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65671.log 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44958.log.gz 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40283.log 2024-09-16T14:40:11.271 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35288.log 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65671.log.gz 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40283.log.gz 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65417.log 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35288.log.gz 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36514.log 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2024-09-16T14:40:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65417.log: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.65417.log.gz 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50515.log 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36514.log.gz 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47958.log: 28.9% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35766.log 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50515.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46521.log 2024-09-16T14:40:11.273 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50515.log.gz/var/log/ceph/ceph-client.admin.52907.log: 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35766.log.gz 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46521.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.46521.log.gz 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58779.log 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32717.log: 1.2%gzip -5 --verbose /var/log/ceph/ceph-client.admin.33193.log: -- /var/log/ceph/ceph-client.admin.56200.log 2024-09-16T14:40:11.274 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56520.log 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58779.log.gz 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64240.log 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56200.log.gz 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64283.log 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56520.log.gz 2024-09-16T14:40:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64949.log 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64240.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.64240.log.gz-- 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37330.log 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64283.log.gz 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37955.log 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64949.log.gz 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68653.log 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37330.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz-5 2024-09-16T14:40:11.276 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.59187.log 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.37955.log.gz 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68653.log.gz 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55239.log 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59187.log.gz 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51754.log 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-09-16T14:40:11.277 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55239.log.gz 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51754.log.gz 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61601.log 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55259.log 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61601.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph.tmp-client.admin.17205.log -- replaced with /var/log/ceph/ceph-client.admin.61601.log.gz 2024-09-16T14:40:11.278 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55259.log.gz 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.tmp-client.admin.17205.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17205.log.gz 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31337.log 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2024-09-16T14:40:11.279 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55663.log 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31337.log.gz 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.55663.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66122.log 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55663.log.gz 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41038.log: 0.0%/var/log/ceph/ceph-client.admin.66122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51518.log 2024-09-16T14:40:11.280 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66122.log.gz 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26724.log 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51604.log 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51518.log.gz 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26724.log.gz 2024-09-16T14:40:11.281 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51604.log.gz 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33826.log 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42025.log: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71084.log 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.33826.log: --verbose -- /var/log/ceph/ceph-client.admin.31488.log 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33826.log.gz 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2024-09-16T14:40:11.282 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71084.log.gz 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31466.log 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31488.log.gz 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63643.log 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47794.log 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31466.log.gz 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32258.log 2024-09-16T14:40:11.283 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63643.log.gz 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67068.log 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47794.log.gz 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29444.log 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32258.log.gz 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62470.log 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67068.log: 0.0%/var/log/ceph/ceph-client.admin.29444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37228.log 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67068.log.gz 2024-09-16T14:40:11.284 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29444.log.gz 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62470.log.gz 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71463.log 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37228.log.gz 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68439.log 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35987.log: 0.0%/var/log/ceph/ceph-client.admin.71463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60804.log 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71463.log.gz 2024-09-16T14:40:11.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.68439.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68439.log.gz 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39831.log 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.60804.log.gz 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47814.log 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46862.log 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39831.log.gz 2024-09-16T14:40:11.286 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34086.log 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47814.log.gz 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61800.log 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46862.log.gz 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66617.log 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34086.log.gz 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61800.log.gz 2024-09-16T14:40:11.287 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59424.log 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66617.log.gz 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59940.log 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65778.log 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59424.log.gz 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42793.log 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59940.log.gz 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57946.log 2024-09-16T14:40:11.288 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65778.log.gz 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33703.log 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.42793.log.gz 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29144.log 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57946.log.gz 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2024-09-16T14:40:11.289 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29144.log.gz 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60285.log 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27256.log 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27111.log 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60285.log.gz 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27256.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.27256.log.gz 2024-09-16T14:40:11.290 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27111.log.gz 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36123.log 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39447.log: /var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47999.log 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60268.log 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36123.log.gz 2024-09-16T14:40:11.291 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47999.log.gz 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42525.log 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60268.log.gz 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51030.log 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36157.log 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42525.log.gz 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32581.log 2024-09-16T14:40:11.292 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51030.log.gz 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36157.log.gz/var/log/ceph/ceph-client.admin.32581.log: 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32581.log.gz 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36327.log 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68009.log 2024-09-16T14:40:11.293 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50536.log 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36327.log.gz 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28823.log 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68009.log.gz 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67987.log 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50536.log.gz 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32105.log 2024-09-16T14:40:11.294 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28823.log.gz 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56707.log 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67987.log.gz 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69599.log 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32105.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32105.log.gz 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56707.log.gz 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63923.log 2024-09-16T14:40:11.295 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69599.log.gz 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26700.log 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65502.log 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.63923.log.gz 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46798.log 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26700.log.gz 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log /var/log/ceph/ceph-client.admin.65502.log: 2024-09-16T14:40:11.296 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65502.log.gz 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46798.log.gz 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.57223.log: --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62706.log 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58452.log 2024-09-16T14:40:11.297 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51561.log 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62706.log.gz 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58452.log.gz 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51561.log.gz 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28264.log 2024-09-16T14:40:11.298 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43810.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33866.log 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28264.log.gz 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46884.log 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33866.log: /var/log/ceph/ceph-client.admin.44529.log 2024-09-16T14:40:11.299 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33866.log.gz 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56538.log 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46884.log.gz 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.44529.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48872.log 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56538.log: 24.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log: /var/log/ceph/ceph-client.admin.38270.log 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56538.log.gz 2024-09-16T14:40:11.300 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65692.log 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48872.log.gz 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64627.log 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38270.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69711.log 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65692.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.65692.log.gz 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62803.log 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64627.log.gz 2024-09-16T14:40:11.301 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26087.log 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69711.log: 10.9% -- replaced with /var/log/ceph/ceph-client.admin.69711.log.gz 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27683.log 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62803.log.gzgzip 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.71300.log 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26087.log.gz 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28031.log 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27683.log.gz 2024-09-16T14:40:11.302 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71300.log.gz 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65864.log 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28031.log.gz 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31660.log 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65864.log.gz 2024-09-16T14:40:11.303 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31660.log.gz 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63077.log 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60437.log 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47400.log 2024-09-16T14:40:11.304 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63077.log.gz 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36429.log 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60437.log.gz 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34928.log 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47400.log.gz 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55641.log 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36429.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57650.log 2024-09-16T14:40:11.305 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36429.log.gz/var/log/ceph/ceph-client.admin.34928.log: 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34928.log.gz 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40952.log 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55641.log.gz 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57650.log.gz 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27004.log 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40952.log.gz 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2024-09-16T14:40:11.306 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27004.log.gz 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60420.log 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72224.log 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57201.log 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60420.log.gz 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70243.log 2024-09-16T14:40:11.307 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72224.log.gz 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60454.log 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57201.log.gz 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70243.log.gz 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30754.log 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60454.log.gz 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38880.log 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-09-16T14:40:11.308 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63526.log 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30754.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.30754.log.gz 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59316.log 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38880.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38880.log.gz 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29315.log 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63526.log.gz 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62491.log 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59316.log.gz 2024-09-16T14:40:11.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36089.log 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29315.log.gz 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35648.log 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62491.log.gz 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37092.log 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36089.log.gz 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31208.log 2024-09-16T14:40:11.310 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35648.log.gz 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51477.log 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37092.log.gz 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31208.log.gz 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55323.log 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51477.log: gzip 54.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.51477.log.gz--verbose 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:-- /var/log/ceph/ceph-client.admin.31767.log 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.55323.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63137.log 2024-09-16T14:40:11.311 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55323.log.gz 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31767.log.gzgzip 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63137.log.gz 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38670.log 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-09-16T14:40:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35128.log 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38670.log: 23.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29047.log 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38670.log.gz 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57727.log 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35128.log.gz 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.29047.log: -- /var/log/ceph/ceph-client.admin.37829.log 2024-09-16T14:40:11.313 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.29047.log.gz 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66273.log 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57727.log.gz 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37829.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37829.log.gz 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35468.log 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66273.log.gz 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48288.log 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32938.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-09-16T14:40:11.314 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56814.log 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35468.log.gz 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59531.log 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48288.log.gz 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.56814.log: --verbose -- /var/log/ceph/ceph-client.admin.55620.log 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56814.log.gz 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37024.log 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59531.log.gz 2024-09-16T14:40:11.315 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68806.log 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55620.log.gz 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65821.log 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37024.log.gz 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62510.log 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68806.log.gz 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54131.log 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65821.log.gz 2024-09-16T14:40:11.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36990.log 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.62510.log.gz 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65523.log 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54131.log.gz 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36990.log.gz 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36650.log 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65523.log.gz 2024-09-16T14:40:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32649.log 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55051.log 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36650.log.gz 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32649.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55051.log.gz 2024-09-16T14:40:11.318 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30540.log 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30561.log 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32700.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30540.log.gz 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30561.log.gz 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-09-16T14:40:11.319 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46559.log 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37618.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51138.log 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40698.log 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46559.log.gz 2024-09-16T14:40:11.320 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60705.log 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51138.log.gz 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37058.log 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40698.log.gz 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28093.log 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60705.log.gz 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37058.log.gz 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60651.log /var/log/ceph/ceph-client.admin.28093.log: 2024-09-16T14:40:11.321 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28093.log.gz 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59875.log 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70730.log 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60651.log.gz 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41925.log 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59875.log.gz 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63017.log 2024-09-16T14:40:11.322 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70730.log.gz 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41925.log.gz 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63017.log.gz 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43000.log 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log: /var/log/ceph/ceph-client.admin.56114.log 2024-09-16T14:40:11.323 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43000.log.gz 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56114.log.gz 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30626.log 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32989.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log: /var/log/ceph/ceph-client.admin.40462.log 2024-09-16T14:40:11.324 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61883.log.gz 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41532.log 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30626.log.gz 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35608.log 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41532.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.40462.log.gz 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41532.log.gz 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53136.log 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-09-16T14:40:11.325 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66294.log 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35608.log.gz 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26139.log 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53136.log.gz 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29616.log 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66294.log: 0.0%/var/log/ceph/ceph-client.admin.26139.log: -- replaced with /var/log/ceph/ceph-client.admin.66294.log.gz 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72278.log 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26139.log.gz 2024-09-16T14:40:11.326 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31115.log 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29616.log.gz 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72278.log.gz 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31115.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.31115.log.gz 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57480.log 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68159.log 2024-09-16T14:40:11.327 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42384.log: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57480.log.gz 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68159.log.gz 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33210.log 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70895.log 2024-09-16T14:40:11.328 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59961.log 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33210.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33210.log.gz 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42688.log 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70895.log.gz 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63470.log 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59961.log.gz 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50348.log 2024-09-16T14:40:11.329 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42688.log.gz 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34506.log 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63470.log.gz 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29916.log 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50348.log.gz 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51711.log 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34506.log.gz 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39153.log 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29916.log.gz 2024-09-16T14:40:11.330 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35048.log 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51711.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.47634.log -- replaced with /var/log/ceph/ceph-client.admin.51711.log.gz 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39153.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.39153.log.gz 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29895.log 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35048.log.gz 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-09-16T14:40:11.331 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29895.log.gz 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58552.log 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52458.log 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gz 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37661.log 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58552.log.gz 2024-09-16T14:40:11.332 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43868.log 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52458.log.gz 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37661.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37661.log.gz 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60401.log 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43868.log.gz 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34788.log 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65479.log 2024-09-16T14:40:11.333 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60401.log.gz 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34788.log.gz 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40801.log 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65479.log.gz 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31509.log 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65007.log 2024-09-16T14:40:11.334 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40801.log.gz 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59703.log 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31509.log.gz 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69448.log 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65007.log.gz 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46328.log 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59703.log.gz 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37313.log 2024-09-16T14:40:11.335 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69448.log.gz 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58102.log 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46328.log.gz 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66187.log 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37313.log.gz 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26035.log 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58102.log.gz 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29064.log 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66187.log.gz 2024-09-16T14:40:11.336 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54648.log 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26035.log.gz 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71273.log 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29064.log: 28.2% -- replaced with /var/log/ceph/ceph-client.admin.29064.log.gz 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40389.log 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54648.log.gz 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56400.log 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71273.log.gz 2024-09-16T14:40:11.337 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30733.log 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40389.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40389.log.gz 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60099.log 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56400.log.gz 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30733.log.gz 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30174.log 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60099.log.gz 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60668.log 2024-09-16T14:40:11.338 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.30174.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30174.log.gz 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60668.log.gz 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67563.log 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63583.log 2024-09-16T14:40:11.339 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67111.log 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67563.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.67563.log.gz 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63583.log.gz 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60632.log 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67111.log.gz 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-16T14:40:11.340 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41760.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55406.log 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60632.log.gz 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32054.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55406.log.gz 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47421.log 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32819.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 2024-09-16T14:40:11.341 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39659.log 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47421.log.gz 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61561.log 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.39659.log: --verbose -- /var/log/ceph/ceph-client.admin.67923.log 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39659.log.gz 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2024-09-16T14:40:11.342 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61561.log.gz 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70216.log 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67923.log.gz 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20937.log 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70216.log.gz 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63763.log 2024-09-16T14:40:11.343 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.20937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20937.log.gz 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54519.log 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54562.log 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63763.log.gz 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69641.log 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54519.log.gz 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2024-09-16T14:40:11.344 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54562.log.gz 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27493.log 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69641.log.gz 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67458.log 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27493.log.gz 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log: /var/log/ceph/ceph-client.admin.47898.log 2024-09-16T14:40:11.345 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47034.log 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67458.log: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.67458.log.gz 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31938.log 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47034.log.gz 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-09-16T14:40:11.346 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69491.log 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31938.log: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.31938.log.gz 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56599.log 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66918.log 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69491.log.gz 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T14:40:11.347 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56599.log: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.56599.log.gz 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43889.log 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66918.log.gz 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57967.log 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58994.log 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43889.log.gz 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64000.log 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57967.log.gz 2024-09-16T14:40:11.348 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58994.log.gz 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57532.log 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64000.log.gz 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52480.log 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57532.log.gz 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25691.log 2024-09-16T14:40:11.349 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33448.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27815.log 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52480.log.gz 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32343.log 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25691.log.gz 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34446.log 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27815.log.gz 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54734.log 2024-09-16T14:40:11.350 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32343.log.gz 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57550.log 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34446.log.gz 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54734.log.gz 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56093.log 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57550.log.gz 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69620.log 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz 2024-09-16T14:40:11.351 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61902.log 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56093.log.gz 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69620.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.69620.log.gz-- 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51539.log 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53615.log 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61902.log.gz 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68353.log 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz 2024-09-16T14:40:11.352 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57072.log 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53615.log.gz 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68353.log.gz 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57137.log 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57072.log.gz 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57094.log 2024-09-16T14:40:11.353 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57137.log.gz 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.41489.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34306.log 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54433.log 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57094.log.gz 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55113.log 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34306.log.gz 2024-09-16T14:40:11.354 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54433.log.gz 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70108.log 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55113.log.gz 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61920.log 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48478.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52640.log 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70108.log.gz 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-09-16T14:40:11.355 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61920.log.gz 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52640.log.gz 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65843.log 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33023.log 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32615.log 2024-09-16T14:40:11.356 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65843.log.gz 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33023.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33023.log.gz 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71327.log 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33567.log 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32615.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32615.log.gz 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51797.log 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71327.log.gz 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33567.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.33567.log.gz 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57748.log 2024-09-16T14:40:11.357 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.51797.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41511.log 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51797.log.gz 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.57748.log: --verbose -- /var/log/ceph/ceph-client.admin.69212.log 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57748.log.gz 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56660.log 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41511.log.gz 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50987.log 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69212.log.gz 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.56660.log: --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-09-16T14:40:11.358 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.56660.log.gz 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27314.log 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50987.log.gz 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69470.log 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44108.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28052.log 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27314.log.gz 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47464.log 2024-09-16T14:40:11.359 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69470.log.gz 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69694.log 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28052.log.gz 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51690.log 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47464.log.gz 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69694.log.gz 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51690.log.gz 2024-09-16T14:40:11.360 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27625.log 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61284.log 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27625.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.27625.log.gz 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.61284.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61284.log.gz 2024-09-16T14:40:11.361 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56179.log 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31531.log 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56179.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57611.log 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56179.log.gz 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26982.log 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31531.log.gz 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57611.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57611.log.gz-5 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.26678.log 2024-09-16T14:40:11.362 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26982.log.gz 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31316.log 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26678.log.gz 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35108.log 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31316.log.gz 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29552.log 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35108.log.gz 2024-09-16T14:40:11.363 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57831.log 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.29552.log: -- /var/log/ceph/ceph-client.admin.59273.log 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29552.log.gz 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57831.log.gz 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35688.log 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27435.log 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59273.log.gz 2024-09-16T14:40:11.364 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35688.log.gz 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34546.log 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52971.log 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr: 2.5%/var/log/ceph/ceph-client.admin.50183.log: -- replaced with /var/log/ceph/ceph-client.admin.27435.log.gz 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30389.log 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34546.log.gz 2024-09-16T14:40:11.365 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42100.log 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52971.log.gz 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26810.log 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30389.log.gz 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42100.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.42100.log.gz 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59553.log 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26810.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-09-16T14:40:11.366 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42324.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34606.log 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59553.log.gz 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52227.log 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31056.log: 23.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55512.log 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz/var/log/ceph/ceph-client.admin.34606.log: 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34606.log.gz 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52227.log.gz 2024-09-16T14:40:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28716.log 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68331.log 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55512.log: /var/log/ceph/ceph-client.admin.28716.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.55512.log.gz/var/log/ceph/ceph-client.admin.49861.log 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28716.log.gz 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68331.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68331.log.gz 2024-09-16T14:40:11.368 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67336.log 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2%/var/log/ceph/ceph-client.admin.67336.log: -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67336.log.gz 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.45628.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37745.log 2024-09-16T14:40:11.369 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37745.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.37745.log.gz 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27184.log 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57266.log 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61779.log 2024-09-16T14:40:11.370 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27184.log.gz 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39616.log 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57266.log.gz 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61346.log 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61779.log.gz 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39616.log.gz 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61346.log.gz 2024-09-16T14:40:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34526.log 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26961.log /var/log/ceph/ceph-client.admin.45324.log: 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34526.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65606.log 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34526.log.gz 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26961.log.gz 2024-09-16T14:40:11.372 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32173.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66208.log 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65606.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.66208.log: -- /var/log/ceph/ceph-client.admin.56986.log 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.65606.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66208.log.gz 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69147.log 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-09-16T14:40:11.373 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71003.log 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56986.log.gz 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69147.log.gz 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69929.log 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71003.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28200.log 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43946.log: -- replaced with /var/log/ceph/ceph-client.admin.71003.log.gz 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69929.log: 45.6% -- replaced with /var/log/ceph/ceph-client.admin.69929.log.gz 2024-09-16T14:40:11.374 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31981.log 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28200.log.gz 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69061.log 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31981.log.gz 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69061.log.gz 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28372.log 2024-09-16T14:40:11.375 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33057.log 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28372.log.gz 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55749.log 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33057.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33057.log.gz 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-16T14:40:11.376 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27966.log 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55749.log.gz 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65129.log 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz/var/log/ceph/ceph-client.admin.27966.log: 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27966.log.gz 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28565.log 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2024-09-16T14:40:11.377 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.65129.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64326.log 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65129.log.gz 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28565.log: /var/log/ceph/ceph-client.admin.55684.log 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28565.log.gz 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32513.log 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64326.log.gz 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55684.log.gz 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T14:40:11.378 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69852.log 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32513.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32513.log.gz 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41780.log 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54820.log 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.69852.log.gz 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72251.log 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41780.log.gz 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42855.log 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54820.log.gz 2024-09-16T14:40:11.379 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72251.log.gz 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42855.log.gz 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39595.log 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37850.log 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32122.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2024-09-16T14:40:11.380 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39595.log.gz 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37850.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37850.log.gz 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55093.log 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2024-09-16T14:40:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68699.log 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gz 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35902.log 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55093.log.gz 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37398.log 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68699.log.gz 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53338.log 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35902.log.gz 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64648.log 2024-09-16T14:40:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37398.log.gz 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53338.log.gz 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52930.log 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64648.log.gz 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50557.log 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43847.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50794.log 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52930.log.gz 2024-09-16T14:40:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72089.log 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50557.log.gz 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50794.log: /var/log/ceph/ceph-client.admin.51733.log 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50794.log.gz 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65357.log 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72089.log.gz 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64541.log 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51733.log.gz 2024-09-16T14:40:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.65357.log: --verbose -- /var/log/ceph/ceph-client.admin.31168.log 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65357.log.gz 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64541.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57632.log 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31168.log: -- replaced with /var/log/ceph/ceph-client.admin.64541.log.gz 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31168.log.gz 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61250.log 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44188.log: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-09-16T14:40:11.385 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33926.log 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57632.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61155.log 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57632.log.gz 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33746.log 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61250.log.gz 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33926.log.gz 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61155.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63430.log 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61155.log.gz 2024-09-16T14:40:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33746.log.gz 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53808.log 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63430.log.gz 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56728.log 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26007.log 2024-09-16T14:40:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53808.log.gz 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66423.log 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56728.log.gz 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61718.log 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26007.log.gz 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67149.log 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66423.log.gz 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-09-16T14:40:11.388 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61718.log.gz 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64412.log 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67149.log.gz 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71571.log 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66466.log 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64412.log.gz 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71165.log 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71571.log.gz 2024-09-16T14:40:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61996.log 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66466.log.gz 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28114.log 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71165.log.gz 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58865.log 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61996.log: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.61996.log.gz 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28737.log 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28114.log.gz 2024-09-16T14:40:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58865.log.gz 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57373.log 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36225.log /var/log/ceph/ceph-client.admin.28737.log: 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28737.log.gz 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52337.log 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57373.log.gz 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36225.log.gz 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27047.log 2024-09-16T14:40:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68589.log 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52337.log.gz 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29401.log 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27047.log.gz 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64562.log 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68589.log.gz 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61233.log 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29401.log.gz 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2024-09-16T14:40:11.392 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64562.log.gz 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61233.log.gz 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66638.log 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-09-16T14:40:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27833.log 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66638.log.gz 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44471.log 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27833.log.gz 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53465.log 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44471.log.gz 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64970.log 2024-09-16T14:40:11.394 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51926.log 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53465.log.gz 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61524.log 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64970.log.gz 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61938.log 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51926.log.gz 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61524.log.gz 2024-09-16T14:40:11.395 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43670.log 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61938.log.gz 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26377.log 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62170.log 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43670.log.gz 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67682.log 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26377.log.gz 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30824.log 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62170.log.gz 2024-09-16T14:40:11.396 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67682.log.gz 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37347.log 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58822.log 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30824.log.gz 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38228.log 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30843.log 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58822.log.gz 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62785.log 2024-09-16T14:40:11.397 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38228.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71788.log 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30843.log.gz 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62785.log.gz 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60228.log 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71788.log.gz 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65585.log 2024-09-16T14:40:11.398 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40995.log 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60228.log.gz 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65585.log.gz 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40995.log.gz 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2024-09-16T14:40:11.399 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25854.log 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44408.log 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49539.log 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25854.log.gz 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25686.log 2024-09-16T14:40:11.400 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67132.log 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49539.log.gz 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25686.log.gz 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34166.log 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67132.log.gz 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51116.log 2024-09-16T14:40:11.401 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33414.log 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34166.log.gz 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41446.log 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69850.log 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51116.log.gz 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33414.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33414.log.gz 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59746.log 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41446.log.gz 2024-09-16T14:40:11.402 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45564.log 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47774.log 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr: 54.9%/var/log/ceph/ceph-client.admin.59746.log: -- replaced with /var/log/ceph/ceph-client.admin.69850.log.gz 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59746.log.gzgzip /var/log/ceph/ceph-client.admin.45564.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45564.log.gz 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47774.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25770.log 2024-09-16T14:40:11.403 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47774.log.gz 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68932.log 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0%/var/log/ceph/ceph-client.admin.38733.log: -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50944.log 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25770.log.gz 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25927.log 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68932.log.gz 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54777.log 2024-09-16T14:40:11.404 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31445.log 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50944.log.gz 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25927.log.gz 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54777.log.gz 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41614.log 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31445.log.gz 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2024-09-16T14:40:11.405 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62055.log 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41614.log.gz 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44894.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36259.log 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62055.log: -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62055.log.gz 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-09-16T14:40:11.406 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63683.log 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36259.log.gz 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58632.log 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63683.log.gz 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-09-16T14:40:11.407 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz/var/log/ceph/ceph-client.admin.58632.log: 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58632.log.gz 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34186.log 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34186.log.gz 2024-09-16T14:40:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38081.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65173.log 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 /var/log/ceph/ceph-client.admin.50242.log: --verbose -- /var/log/ceph/ceph-client.admin.55899.log 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65173.log.gz 2024-09-16T14:40:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64928.log 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55899.log.gz 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32564.log 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43827.log 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64928.log.gz 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63354.log 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32564.log.gz 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63238.log 2024-09-16T14:40:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43827.log.gz 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62823.log 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63354.log.gz 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63238.log.gz 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63703.log 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62823.log.gz 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48851.log 2024-09-16T14:40:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69513.log 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63703.log: 0.0%gzip /var/log/ceph/ceph-client.admin.48851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63703.log.gz 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48851.log.gz 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69513.log.gz 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56221.log 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36055.log 2024-09-16T14:40:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61173.log 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56221.log.gz 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42482.log 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36055.log.gz 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29337.log 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61173.log.gz 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51073.log 2024-09-16T14:40:11.413 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42482.log.gz 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28780.log 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48188.log 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51073.log.gz 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28780.log.gz 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55154.log 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48188.log.gz 2024-09-16T14:40:11.414 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30325.log 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38291.log: 23.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38459.log 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55154.log: -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55154.log.gz 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30325.log.gz 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68417.log 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38459.log: 23.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60976.log 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34006.log: -- replaced with /var/log/ceph/ceph-client.admin.38459.log.gz 2024-09-16T14:40:11.415 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gz 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68868.log 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68417.log.gz 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25954.log 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60976.log.gz 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68868.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60142.log 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68868.log.gz 2024-09-16T14:40:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70784.log 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25954.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25954.log.gz 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68396.log 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60142.log.gz 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70784.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69828.log 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70784.log.gz 2024-09-16T14:40:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28178.log 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68396.log.gz 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69828.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.69828.log.gz 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66552.log 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28178.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29251.log 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28178.log.gz 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2024-09-16T14:40:11.418 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66552.log.gz 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62307.log 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29251.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.27645.log 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29251.log.gz 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52141.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55964.log 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2024-09-16T14:40:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55029.log 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62307.log.gz 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27645.log.gz 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68374.log 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61638.log 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55964.log.gz 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55029.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63566.log 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55029.log.gz 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30110.log 2024-09-16T14:40:11.420 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68374.log.gz 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61638.log.gz 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30282.log 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53278.log 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63566.log.gz 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30110.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64756.log 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30110.log.gz 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2024-09-16T14:40:11.421 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30282.log.gz 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53278.log.gz 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65714.log 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64756.log.gz 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58142.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60249.log 2024-09-16T14:40:11.422 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65714.log.gz 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67004.log 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60249.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60610.log 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60249.log.gz 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30583.log 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gz 2024-09-16T14:40:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67004.log.gz 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60610.log.gz 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30583.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32139.log 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30583.log.gz 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47163.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz-5 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-09-16T14:40:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26549.log 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32139.log: gzip /var/log/ceph/ceph-client.admin.51625.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32139.log.gz 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.26549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26549.log.gz 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45779.log 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-09-16T14:40:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66595.log 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62267.log 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45779.log.gz 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46144.log 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66595.log.gz 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43352.log 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62267.log.gz 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67269.log 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46144.log.gz 2024-09-16T14:40:11.426 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43352.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.43352.log.gz 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68568.log 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67269.log.gz 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64455.log 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gz 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70595.log 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68568.log.gz 2024-09-16T14:40:11.427 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28415.log 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64455.log.gz 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59166.log 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70595.log.gz 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28415.log.gz 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59166.log.gz 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35817.log 2024-09-16T14:40:11.428 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28982.log 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67521.log 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35817.log.gz 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25531.log 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28982.log: 6.3% -- replaced with /var/log/ceph/ceph-client.admin.28982.log.gz 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67521.log.gz 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36497.log 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-09-16T14:40:11.429 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25531.log.gz 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59058.log 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36497.log.gz 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69319.log 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38985.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58800.log 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59058.log.gz 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69018.log 2024-09-16T14:40:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69319.log.gz 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58800.log.gz 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69677.log 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69018.log.gz 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31810.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71980.log 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69677.log.gz 2024-09-16T14:40:11.431 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53830.log 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48123.log 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71980.log.gz 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.53830.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53830.log.gz 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31595.log 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48123.log.gz 2024-09-16T14:40:11.432 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.35168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.64734.log 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31595.log.gz 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64734.log.gz 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.32377.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61842.log 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55878.log 2024-09-16T14:40:11.433 INFO:teuthology.orchestra.run.smithi137.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41983.log 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61842.log.gz 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50451.log 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55878.log.gz 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41983.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.41983.log.gz 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2024-09-16T14:40:11.434 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63904.log 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69891.log 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63904.log.gz 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29229.log 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69891.log: 51.0% -- replaced with /var/log/ceph/ceph-client.admin.69891.log.gz 2024-09-16T14:40:11.435 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63391.log 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29229.log.gz 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49194.log 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51393.log 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63391.log.gz 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28651.log 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49194.log.gz 2024-09-16T14:40:11.436 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51393.log.gz 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50686.log 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28651.log.gz 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64476.log 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50686.log.gz 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-09-16T14:40:11.437 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63219.log 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64476.log.gz 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54218.log 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63219.log.gz 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64691.log 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-16T14:40:11.438 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53258.log 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54218.log.gz 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64691.log.gz 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59983.log 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53258.log.gz 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32156.log 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2024-09-16T14:40:11.439 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46346.log 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59983.log.gz 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46346.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32156.log.gz 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46346.log.gz 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39788.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz-5 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.36072.log 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65800.log 2024-09-16T14:40:11.440 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57988.log 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65800.log.gz 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39724.log 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57988.log.gz 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68997.log 2024-09-16T14:40:11.441 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38375.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54261.log 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39724.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.39724.log.gz 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63037.log 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29787.log 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68997.log.gz 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54261.log.gz/var/log/ceph/ceph-client.admin.63037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29809.log 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.442 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63037.log.gz 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61095.log 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29787.log.gz 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58972.log 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29809.log.gz 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53679.log 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61095.log: gzip /var/log/ceph/ceph-client.admin.58972.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr: 56.4% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58972.log.gz 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61095.log.gz 2024-09-16T14:40:11.443 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42916.log 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.53679.log.gz 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46776.log 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42916.log.gz 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56620.log 2024-09-16T14:40:11.444 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58046.log 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43270.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42205.log 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56620.log.gz 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51159.log 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70568.log 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42205.log: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.58046.log.gz 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.42205.log.gz 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.51159.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37160.log 2024-09-16T14:40:11.445 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70568.log.gz 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34646.log 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37160.log.gz 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59574.log 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34646.log.gz 2024-09-16T14:40:11.446 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71544.log 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59574.log.gz 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68073.log 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37913.log 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71544.log.gz 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68073.log: /var/log/ceph/ceph-client.admin.29680.log 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68073.log.gz 2024-09-16T14:40:11.447 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.37913.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52701.log 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29680.log.gz 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56157.log 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.20912.log 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52701.log.gz 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54669.log 2024-09-16T14:40:11.448 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56157.log.gz 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53199.log 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.20912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.20912.log.gz 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40218.log 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54669.log.gz 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25583.log 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53199.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.53199.log.gz 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.40218.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-09-16T14:40:11.449 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40218.log.gz 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66531.log 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.25583.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.25583.log.gz 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44208.log 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35508.log 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66531.log.gz 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58304.log 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66810.log 2024-09-16T14:40:11.450 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35508.log.gz 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58304.log.gz 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68267.log 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66810.log.gz 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41124.log 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2024-09-16T14:40:11.451 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68267.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.68267.log.gz/var/log/ceph/ceph-client.admin.32292.log 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41124.log.gz 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34988.log 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32292.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32292.log.gz 2024-09-16T14:40:11.452 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67479.log 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34988.log.gz 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33584.log: 31.7%/var/log/ceph/ceph-client.admin.40175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63864.log 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64118.log 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67479.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.67479.log.gz 2024-09-16T14:40:11.453 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42045.log 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63864.log.gz 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63964.log 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64118.log.gz 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.42045.log: -- /var/log/ceph/ceph-client.admin.55134.log 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.42045.log.gz 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27352.log 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63964.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71246.log 2024-09-16T14:40:11.454 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55134.log: 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.27352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27352.log.gz 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56640.log 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71246.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41167.log 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71246.log.gz 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61267.log 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-09-16T14:40:11.455 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56640.log.gz 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41167.log.gz 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28350.log 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61267.log.gz 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62190.log 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28350.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-09-16T14:40:11.456 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28350.log.gz 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67025.log 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62190.log.gz 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48020.log 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67025.log.gz 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50410.log 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-09-16T14:40:11.457 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64584.log 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30475.log 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48020.log.gz 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50410.log.gz 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64584.log.gz 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30475.log.gz 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55007.log 2024-09-16T14:40:11.458 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:gzip /var/log/ceph/ceph-client.admin.41597.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gz 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42667.log 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55007.log.gz 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33176.log 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32530.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50033.log 2024-09-16T14:40:11.459 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42667.log.gz 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33176.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33176.log.gz 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60551.log 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50033.log.gz 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log /var/log/ceph/ceph-client.admin.43369.log: 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-09-16T14:40:11.460 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60551.log.gz 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log: /var/log/ceph/ceph-client.admin.66961.log 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47534.log: gzip 2.5% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz-5 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:--verbose -- /var/log/ceph/ceph-client.admin.30432.log 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66961.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.52598.log -- replaced with /var/log/ceph/ceph-client.admin.66961.log.gz 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38649.log 2024-09-16T14:40:11.461 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30432.log: 0.0%gzip -5 /var/log/ceph/ceph-client.admin.52598.log: --verbose -- /var/log/ceph/ceph-client.admin.53157.log 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30432.log.gz 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38649.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.38649.log.gz 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53157.log.gz 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54023.log 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59101.log 2024-09-16T14:40:11.462 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54023.log.gz 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34888.log 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59101.log.gz 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58653.log 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68310.log 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34888.log.gz 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66703.log 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58653.log: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.58653.log.gz 2024-09-16T14:40:11.463 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69190.log 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68310.log.gz 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66703.log.gz 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69190.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37997.log 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69190.log.gz 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47717.log 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38102.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-16T14:40:11.464 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41468.log 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37997.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.37997.log.gz 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40132.log 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47717.log.gz 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53572.log 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41468.log.gz 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40132.log.gz 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33886.log 2024-09-16T14:40:11.465 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53572.log.gz 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38018.log 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46600.log 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33886.log.gz 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38018.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.38018.log.gz 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71679.log 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46600.log.gz 2024-09-16T14:40:11.466 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68202.log 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr: 55.0% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71030.log 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71679.log.gz 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68202.log.gz 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39237.log 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71030.log.gz 2024-09-16T14:40:11.467 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66380.log 2024-09-16T14:40:11.468 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2024-09-16T14:40:11.468 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39237.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.39237.log.gz 2024-09-16T14:40:11.468 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66380.log.gz 2024-09-16T14:40:11.594 INFO:teuthology.orchestra.run.smithi137.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T14:40:14.357 INFO:teuthology.orchestra.run.smithi137.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T14:40:14.443 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T14:40:41.031 INFO:teuthology.orchestra.run.smithi137.stderr: 96.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T14:40:47.744 INFO:teuthology.orchestra.run.smithi137.stderr: 96.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T14:40:47.746 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T14:40:47.747 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m37.520s 2024-09-16T14:40:47.747 INFO:teuthology.orchestra.run.smithi137.stderr:user 1m14.463s 2024-09-16T14:40:47.747 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m3.458s 2024-09-16T14:40:47.747 INFO:tasks.ceph:Archiving logs... 2024-09-16T14:40:47.748 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165/remote/smithi137/log 2024-09-16T14:40:47.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T14:40:57.798 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1905, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1300, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2024-09-16T14:40:57.801 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T14:40:57.814 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1905, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1300, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2024-09-16T14:40:57.816 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T14:40:57.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T14:40:57.859 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T14:40:57.873 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T14:40:57.873 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:40:57.898 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:40:57.898 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2024-09-16T14:40:57.899 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 67.205.162.81 3 u 75 256 377 0.148 0.518 0.098 2024-09-16T14:40:57.899 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 256 377 0.172 0.904 0.034 2024-09-16T14:40:57.899 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 15 256 377 0.166 0.468 0.089 2024-09-16T14:40:57.899 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2024-09-16T14:40:57.900 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T14:40:57.916 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T14:40:57.916 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T14:40:57.932 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T14:40:57.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T14:40:57.961 INFO:teuthology.task.internal:Duration was 12784.736250 seconds 2024-09-16T14:40:57.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T14:40:57.975 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T14:40:57.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T14:40:58.027 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T14:40:58.027 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T14:40:58.027 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T14:40:58.040 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T14:40:58.040 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T14:40:58.074 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T14:40:58.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T14:40:58.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T14:40:58.158 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T14:40:58.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T14:40:58.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T14:40:58.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:40:58.228 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-16T14:40:58.251 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:40:58.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:40:58.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T14:40:58.270 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T14:40:58.271 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/sangadi-2024-09-16_10:44:09-rbd-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7907165/remote/smithi137 2024-09-16T14:40:58.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T14:40:58.294 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T14:40:58.295 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T14:40:58.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T14:40:58.350 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T14:40:58.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T14:40:58.366 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T14:40:58.366 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T14:40:58.374 INFO:teuthology.orchestra.run.smithi137.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 16 14:40 /home/ubuntu/cephtest 2024-09-16T14:40:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: 1068711 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 16 11:16 /home/ubuntu/cephtest/mnt.0 2024-09-16T14:40:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: 1068712 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Sep 16 11:17 /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T14:40:58.375 INFO:teuthology.orchestra.run.smithi137.stdout: 1194267 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Sep 16 11:17 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T14:40:58.376 INFO:teuthology.orchestra.run.smithi137.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-16T14:40:58.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:40:58.377 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1905, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks/ceph.py", line 1300, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi137 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-16T14:40:58.392 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T14:40:58.404 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T14:40:58.418 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2024-09-16T14:40:58.422 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} duration: 12784.736250162125 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi137 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d75f23820806da622f561ee5ee7551015285993f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_sangadi@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=230816f1918c4d51a822c2611b4d8f96 status: fail success: false 2024-09-16T14:40:58.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T14:40:58.521 INFO:teuthology.run:FAIL